We are trying to setup Permalinks and Clean URLs for our WordPress site, and need to know how to setup .htaccess on our Windows Hosting account.

From the WordPress dashboard, navigate to Settings, Permalinks
Under Common Settings, set Custom Structure to:

Then add a .htaccess file to the root of your web site with the following contents:

# BEGIN WordPress
RewriteEngine On

RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule . index.php [L]

# END WordPress