I would like to answer this question to help you build confidence. First 3 things to remember is LIVE, BREATH, SPEAK English. Your life from YouTube Videos, TV Channels, Friend Meetings, Work, School, and Play should all be involved in English.
It's about being involved in the language and learning every part. If you don't know how to say something don't give it up, look it up. Fix your mistakes every time you notice you made one and don't worry about correcting yourself in front of others. Just because you are tired doesn't mean you should put on your favorite TV show not in English, or should watch with English subtitles all the time (unless you want to learn reading and writing.)
Learning a language doesn't take a short period of time. Sometimes it takes over 7000 hours of study to learn the language and be comfortable with it. So, to increase more quickly, you need to make sure your life is all about English, even at home or your days off.
Breath it, Speak it, Live it.
Good luck! And I hope this helps. Please let me know if you would like a lesson and I can teach you the skills to improve quicker on your own, as well as, find your mistakes of difficulties in learning and how to overcome them.