Listen Kshake, i know all about this fight club because i used to be in one and same as you guys, i didn't know what i was doing and most of the fights became brawls with very little rules, only stopping when one guy couldn't take it. Then i discovered boxing and everything changed, i found the proper way to box and defend, and realized i had a lot to learn, but was way better off than when i didn't have any background. So learn the proper way and then go back there to fight, you'll be amazed at how you take it.

Hey man, ive been in your shoes before and fought people with no skill and technique and in the end it all became very much like a brawl instead, lasting only as long as the opponent could stand. That was just silly.

The best way to get confidence for yourself is to join boxing, it did wonders for me and once i gained all the skills for offensive and defensive boxing, i wasn't scared to face those that had no prior knowledge in boxing.

Cheers

Kshake, JustinC is right - learn some of the techniques here and those themself will give you some confidence. Right now you're scared because you don't have anything in your arsenal to use, but if you learn some technique you will be way up on those other guys. The thing with most backyard boxing is that neither opponent knows anything (a lot of the time). So, like you said, they both just come out swinging and are hoping to hit. Basically, adrenaline is driving the fighting.

Also, like you said, it is often short lived because both are gassed as the adrenaline wears off and the real level of conditioning becomes apparent.

So, what do you do? First, learn some defence and counterpunches, because no matter how good an offence you have, your opponent is running on adrenaline for the first part of any match and will blindly walk into whatever you are throwing and throw back - they simply can't feel or think at that point - so if you can weather the initial storm with some good defence and counterpunching - you will prevail in the end.

Once that opponent literally can't throw anything anymore or move because he's gasping for breath - then you can launch an assault of your own. Plus, a good counterpunch can instantly change your opponent's fight instinct into a flight instinct.

The other thing is movement. Backyard boxing usually sees the more agressive boxer basically pushing his opponent backwards for most of the fight as he tries to get out of the way. DON'T BACK UP! If he comes at you, step to the side and spin around him - work angles, but don't get caught reeling backwards as he's wailing on you. Sidestep him and make him turn to face you. It will give you openings and stop his momentum.

Last of all is your own attitude - if you think you've lost before you start fighting, then just go hit yourself in a corner until you knock yourself out. You really have to believe you have a chance or nothing you do is going to help you out. Most of that belief comes with confidence in your own ability through what you learn and experience. There will always be some fear, but channel that and trust yourself and you will be a lot more successful than you might think.