Can anyone help me create a line with label like this? The line is cut in the middle. The label is placed on top to avoid the probelem when too points are too close.

This is what I have so far.

lines[{a1_, a2_}, color_, label_] := Block[{d,l},
d = a2 - a1;
l = Norm[d];
  {Thickness[0.01], color, Line[{a1, a2}]}]

Graphics@lines[{{1, 2}, {3, 5}}, Red]

My plan is to make the line segments about 4/10 the distance between two points but I'm having problem making that the end points is on the line through two points instead of the outside.