Electronic – Help identifying fuse 3.6 x 10mm 125 V, 2.5A cylindrical maybe ceramic

Yes, that is a fuse. Just a normal fuse.

You see the little holes above and below it? These look to me like they're to take a standard PCB mount fuse socket.

The solid module is easier to auto-assemble than a traditional fuse. Check the traces under the board - you may well be able to replace it with a standard fuse socket and use a normal fuse.

I was an electrical engineer in the 1950s, part of my work was concerned with testing and selecting fuses. I recently gave a talk to my local amateur radio club on the subject, and what follows is from the script I wrote for that talk. I think it is relevant to the discussion here.

A surge protection fuse must accommodate three overload regions. For a short circuit it must blow fast in the normal way. It must also blow for steady overload currents just like an F fuse, but it must tolerate continual brief over-currents -- say ten times its rating -- without blowing or deteriorating.

Three main techniques are used to accomplish this. The simplest is to increase the thermal mass of the element, using a thicker, and therefore longer wire (to get sufficient resistance to heat up), wound round an insulating core, with careful control of the spacing for consistent operation. Pictures of this type and the next are in @Russell McMahon's answer. I have not seen an explanation of the fuse with the wavy wire.

The second technique employs a three part fusible element.The first part is a wire with a high melting point so that it will absorb surges, while still blowing fast on extreme overload. This is similar to an F fuse working at well below its rating, so it will not protect against overloads close to the rated current. The second part gets round this, providing the protection for currents that are closer to the rated value but not high enough to blow the thin wire itself, and consists of a lump of lower melting point material in series with the main wire, that heats more slowly than the wire. The third part of the element is a stout spring of relatively high resistance material, helping to heat up the lump, and pulling it rapidly apart when it melts. The combination of lump and spring, with its relatively high thermal mass, also allows the surge to pass, but provides the protection for longer term but lesser overloads. There are many variations on this design and it gives manufacturers a lot of parameters for adjusting the fuse characteristics. Occasionally, as in the image above, a by-pass wire across the spring is used to adjust the characteristics of the fuse.

The third method employs the 'M' effect. In the 1930s Prof. A.W.Metcalf (hence the 'M') researched a phenomenon where the tin alloy used to solder the ends of the fuse seemed to affect the time to blow, reducing it in a strange way. He found that a spot (the 'M' spot) of solder on a silver wire element did not affect the short circuit performance, but it did reduce the time to blow on a sustained lower current. In this case, at the lower temperature of the wire, the solder diffused into and alloyed with the silver to create a region of high resistance in the spot, which would glow red hot, with the wire rupturing next to it. This, with suitably chosen alloys, nicely gives the characteristic needed for a surge resistant fuse. A problem with this type of fuse is that occasional currents just above the rated value may cause some unwanted diffusion to occur, altering the fuse characteristics without visible change. Here is a picture of three M spot fuses, and yes there is a tiny spot on the top one.