If there is no icon for Java™ Web Start, you can see if it is installed by clicking "Start" then "Programs" and look for a folder called Java™ Web Start.

If there is no folder under "Programs", that means that Java™ Web Start has not been installed.
Has Java™ Web Start been successfully installed on your computer?