Is it possible to host Worms Armageddon directly on TCP/IP? such that other players can connect just by entering my IP?

Yes! There is a direct TCP/IP option in the internet menu after the game has been updated. Click the button and leave the IP address blank to host, enter the host's IP and click the button to join. This will only work after installing the update from wa.team17.com