LWOP for calling out when I used annual

As the title states I called out for Friday and Saturday using annual via ELRA. I left after an hour on Thursday and went straight to urgent care due to severe vomiting and what not. They said I have the norovirus or whatever. Okay so they give me a note says return to work on the 18th so I called out. Now I’m certain I used annual and have MORE than enough but instead they decided to LWOP me. Is this because of the holiday they decided to screw me over This job already don’t pay us enough I’m only Step A missing 4 days of pay is gonna insure that I’m eating water for 2 weeks and probably can’t make all of my bills.

Edit - Update: they straight up said “it doesn’t work like that if you call out before a holiday your LWOP that’s it”