Traffic not working on port 80 requests

Hello,

For some reason, our web server is no longer accepting request on port 80. However, if i specify https, the sites seem to work. I don't know how this happened, but I think it occurred when I removed a website after someone filed a helpdesk ticket that she was receiving an internal error page when she tried to access a site that redirects.

This is really bad as we have about 50 sites hosted on the server!

http://adamlab.sesp.northwestern.edu vs https://adamlab.sesp.northwestern.edu as an example.

Please help!

  • Ryan
Status: 
Active

Comments

Howdy -- hmm, it appears to be accepting requests, but it's throwing a 404 error. That suggests that the wrong domain may be responding to requests for that website. That may be due to an Apache configuration issue.

You could try taking a look at the troubleshooting document here, which should help identify what is going wrong there:

https://www.virtualmin.com/documentation/web/troubleshooting#toc-the-wro...

Thanks for the quick response. Per those instructions, somehow Apache is now listening for 80 requests on *.80. Is there a way to change this for all of them?

/etc/apache2/sites-enabled/000-default.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/bestpractices.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.geode.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvaslab.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvasresearchproject.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/conceptual-dynamics.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/covis.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/ct-stem.northwestern.edu.conf: /etc/apache2/sites-enabled/destinlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/ecocasting.northwestern.edu.conf: /etc/apache2/sites-enabled/edtech.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/istar.northwestern.edu.conf: /etc/apache2/sites-enabled/knowledgelens.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/myworldgis.org.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/stevenslab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/wiki.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf:

Not an easy one unfortunately... it may be easier to change things (at least temporarily) so that they're all using *.80.

What is the output of this command:

grep -i '<virtualhost' /etc/apache2/sites-enabled/*.conf

In the interest of time, I went through and changed all of them. I'm not sure how this happened. Where do I change this so that future sites are properly configured?

/etc/apache2/sites-enabled/000-default.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/bestpractices.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.geode.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvaslab.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvasresearchproject.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/conceptual-dynamics.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/covis.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/ct-stem.northwestern.edu.conf: /etc/apache2/sites-enabled/destinlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/ecocasting.northwestern.edu.conf: /etc/apache2/sites-enabled/edtech.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/istar.northwestern.edu.conf: /etc/apache2/sites-enabled/knowledgelens.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/myworldgis.org.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/stevenslab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/wiki.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf:

Oh my apologies, you did share that output above, but Drupal mangled it, so I didn't realize that's what you pasted in there.

Let's start here before we get into what might have caused that -- did that solve your problem?

It did, thanks. All the websites are responding on 80 and 443. I feel like this might have happened when I was migrating one of the last sites from our old Virtualmin instance on CentOS 7 to our new instance on Ubuntu 16.

So how do I change Virtualmin to ensure that websites are put on the correct IP address and not the wild cart *.80?

I've been reviewing your output above to try and figure out why this happened in the first place.

Normally, Virtualmin would look at the first (default) domain you have there, and use it to determine how to add the additional domains.

But so far as I can tell, all but one of the domains was using *:80, and the one that didn't have that wasn't the default domain. However, I suppose it's possible that somehow that one was where the requests were being directed to.

Having them all using *:80 can work, they would just all need to be set that way.

Now that all the domains have been corrected, and use the same format, all new domains would be added with that same format.

What I'm curious about is how things got mixed up though... were any domains recently imported?

In particular, I'm curious about the "colyvasresearchproject.sesp.northwestern.edu" domain. Is that a newly added one?

Yes, I feel like someone that domain was the culprit! Because all port 80 domain requests defaulted to the URL, which was the very last domain to migrated from our old Virtualmin instance. I used the Virtualmin backup function on the previous server to send all the domains over to the new one, a few at a time.

Were your other domains migrated in a similar way, all around the same time?

Also, have you completed migrating domains to Virtualmin?

I migrated all of them in chunks using the ssh backup function in Virtualmin. The scp'd the tar file over to /tmp/sitenames.tgz as an example. All of the websites have now been migrated from Centos 7 to Ubuntu 16. Could that have caused the issue?

Jamie, this is all working now, but just a quick question --

sespit had migrated all his domains, by importing backups from another server to this one.

All were using a VirtualHost format of *:80 in the Apache config, except for the last one to be imported, which instead used x.x.x.x:80.

Do you have any thoughts as to what might have triggered that one domain to use a different VirtualHost format?

That is odd ... unless it was on a different IP from the other domains (or a private IP) ?