Postgres database of energy and emissions data and website to present graphic analysis
$8-15 AUD / hour
ที่ทำเสร็จแล้ว
โพสต์ ประมาณ 10 ปีที่ผ่านมา
$8-15 AUD / hour
Postgres database of energy and emissions data and website to present graphic analysis
Postgresql on linux based server
Database of energy and emissions time-series data retrieved from a range of international and national sources.
Scripts to routinely import numerous excel spreadsheets into Postgres tables
Documentation of scripts
Data sources
annual
UNFCCC (details below), BP, IEA
monthly
entso-e, us eia, jodi,
Data source structures:
Mostly Excel spreadsheets, major data source (unfccc) uses zipped, multiple file, multiple sheet excel files.
Host
Host db and present results of analysis at [login to view URL]
Wordpress for public pages
PgAdmin and phpPgAdmin for back end work
Import scripts
annual data (script to retrieve using curl and import with appropriate utility)
unfccc has a new page for each annual release - but new data is added over the following months, so script could run daily to check - but be updated manually each year to point to the new annual release. The unfccc has data for about 40 countries in zipped archives, with one multi-tabbed spreadsheet per year since 1990. Retrive and unpack the zipped archives that are listed as CRFs on the unfccc page: [login to view URL]
BP data: one excel spreadsheet updated annually [login to view URL]
monthly data (cron script to retrieve and import)
from entso-e, us eia, jodi,
excel import utilities
[login to view URL]
[login to view URL]:spatialytics_etl:001_introduction#what_is_an_etl_tool
[login to view URL]
[login to view URL]~jmcnamara/Excel-Writer-XLSX/lib/Excel/Writer/[login to view URL] (also refers to readers)
[login to view URL]
[login to view URL]
[login to view URL]
Postgres data structure
one massive table per data source with fields for:
filename, sheetname, [and then a field for the data from every cell], A1, B1, C1, all the way to the end
Analysis
R
[login to view URL]
[login to view URL]
[login to view URL]
[login to view URL]
Website
Website to display graphic and tabular output. Users may choose pre-defined range of analysis.
Let's discuss over freelancer Personal Message Box for the proper estimation of cost and time.
I am myself doing programming so you will directly work with one person and that's me. No mediators. No managers. No subcontractors.
see my recent work for the technical expertise along with reviews & feedback on my profile page.
I'm an expert Perl programmer with 20+ years experience in developing various software solutions ranging from simple scripts to complete telecommunication platforms. I'm available now and can deliver quick results, thus saving you time and money.
Hello from Hamburg,
I am interested in this project, there is a lot of information I have not read all links yet.
Let me read them and know more about what is the requirement, and we could start to work.
Regards
Oscar