Automation using Virtualmin

6 posts / 0 new
Last post
#1 Thu, 12/09/2010 - 04:07
Colin Brown

Automation using Virtualmin

Hi

Where I work, we have a large number of Linux servers involved in real-time scientific data-processing. Most of these machines have been set to use Webmin for management. What we would like to be able to do is run automated data monitoring mainly through parsing log files on any of the distributed machines.

Our preferred language would be Python. Is it possible to do this via the Virtualmin API? If so, how complex would it be to install given that Webmin is preloaded?

Cheers Colin

Thu, 12/09/2010 - 06:08
Locutus

Virtualmin is a web hosting panel, so its function basically is to automatically configure the required services for web hosting (web, mail, DNS etc.)... I don't really see how your intended use case (execution of data monitoring scripts) should be covered by Virtualmin in any way. To me, this mostly sounds like wanting to use a washing machine to prepare your morning toast. ;)

Sat, 12/11/2010 - 22:01 (Reply to #2)
Colin Brown

Much as I suspected, but there is nothing much "automatic" about manually driven web pages ;-)

Colin

Wed, 12/15/2010 - 15:22 (Reply to #3)
Joe
Joe's picture

Compared to manually driving the several dozen configuration files (httpd.conf, named.conf, zone file, Postfix virtual map file, databases, passwd and shadow, etc.) filling in a few variables on a single page is extremely automatic. (Also, full API. Everything in the Virtualmin UI is also in the API.) ;-)

Basically, though, you are looking in the wrong area for a solution, I think. Virtualmin is about making virtual web hosting really easy and fast. It doesn't sound like virtual web hosting is what you're trying to accomplish, so Virtualmin is not the right tool for the job.

If the data you're aggregating is hosting or system related, Cloudmin has some capabilities in that area, with more being added over time as we see what variables people want to watch. Log gathering is not currently in the mix, but will be eventually. But, again, it's all focused on virtual hosting. If web hosting isn't what you're doing with your servers, Virtualmin and Cloudmin are not for you. Webmin is, as you've noted, great for pretty much any server, and I've been installing it for over a decade on servers in every place I've worked, including a scientific computing company that dealt with jobs running across hundreds of machines.

--

Check out the forum guidelines!

Thu, 12/09/2010 - 08:23
andreychek

To me, this mostly sounds like wanting to use a washing machine to prepare your morning toast.

I dunno, this sounds like a fun weekend project :-)

Our preferred language would be Python. Is it possible to do this via the Virtualmin API?

But yeah, as Locutus said, Virtualmin isn't going to be able to do much to help you here. Virtualmin does collect a few of it's own statistics to put into the GUI to try and make your life a little easier, but that's probably not what your after.

Instead, it sounds like what you're looking to do is to parse files in /var/log, perhaps via cron. That is, you'd use your Python code still, but you may want to setup those Python scripts to run out of cron.

Now, Webmin (or Virtualmin) could help you setup those cron tasks. But your Python script would need to be able to do all the work on it's own, all cron would do is call your Python script periodically.

-Eric

Sun, 10/23/2011 - 12:03
kenlyle

They seem to do what you want, which seems to be some centralized log monitoring. Please post back if you get to try it.

Topic locked