Flying fighters (F-16 for me) is awesome. I've done incredible things I would never had the opportunity to do anywhere else. The flying part: Flying A-B is nothing more than a means to an end...the end being tactically employing the aircraft. Flying the jet is easy, employing it well is difficult. If you want to fly around the world and stay in 69 countries before your first assignment is up, this is not the place. If you want to have "chill" time while flying, fighters are not what you're looking for. That said, I have flown all over this world (for a fighter guy anyways), had countless badass TDYs, and employed weapons in the best (i.e. TDYs) and worst parts of this world. The squadron camaraderie, even under the iron fist of the past few years, is second to none.
Squadron life: Can vary a lot depending on leadership, as I'm sure the same is true in just about every walk of life. I have been fortunate to have great leadership, so my general experiences have been very positive. I know guys who were/are miserable because they have shitty leadership. Luck and timing matters. In the CAF, I'd say the average guy works 12 hrs day, 5 days a week. It's not uncommon to come in on the weekend to do 2-6 hrs of mission planning for a Mon sortie (because everyone was too hammered or didn't give a shit on Fri afternoon after academics and pilot meetings). However, that's personal choice; dudes could get it done on Fri and have the whole weekend off. You're expected to work your ass off on the tactical side to be a good fighter pilot, but there is still all of the BS that has to get done. You will have a lot to balance, but it is doable and the reward of flying the mission is worth it...at least for a while. If you go to other assignments such as teach B-Course, test, etc. life can ease up a bit and you're not necessarily working 60+ hr weeks...those are good "break for the family" assignments.
Family life: It seems in general we are not on the road nearly as much has the AMC/AFSOC bros. But, depending on what's going on the squadron, those 12+ hr days can lead to a lot of missed dinners with the family, etc. There was about a 4 month period (no TDY, no deployment) where I didn't see my first kid 5 days a week because I left for work before he woke up and came home after he went to bed...I made the weekend family time. Overall, in my time flying fighters, I've been gone roughly 50% of the time (TDYs or deployed). Some guys hit more or less, but I'd say 50% is about the average. Overall for my family personally, we prefer longer time away with less frequency. Other communities do less time away, but far more frequently. That may work out better for other's family situation.
Overall, I absolutely recommend dudes look into fighters. I think the best analogy I can think of is it's like playing team sports - very competitive (in a good way), you're very close with the bros (work and leisure), and you fly the jet/work together to win. Or you lose, but you learn and get better so when the big game kicks off, you're ready. It's a constant challenge that I personally would be bored without.