I have a Ubuntu server running NGINX that logs data for me. I want to write a python script that reads my customized logs and after a little rearrangement save the new data into my DB (postgresql).
The process should run about every 5 minutes and i'm expecting large chunks of data on several 5 minute windows..
My plan for achieving this is to install python on the server, write a script and add it to cron.
My question is what the simplest way to do this? should I use any python frameworks?
For my python app I'm using Django, but on this server I just need to read a file, do some manipulation and save to DB.