Error trying to publish a web site from VS 2015 to Azure

If you try to publish your web site to Azure using VS 2015, you may face following error.

Can't find existing loaded project:http://localhost:6002

        ========== Build: 1 succeeded or up-to-date, 0 failed, 0 skipped ==========
        ========== Publish: 0 succeeded, 1 failed, 0 skipped ==========

To overcome that error, 

Open VS, go to View --> Other Windows --> Web Publish Activity

Click on Publish icon in there and it should do it.