讲解：IA626、analysis、Python、PythonR|Java

Final Project - IA626SummaryThe final project for IA-626 will be an open ended project including the topics below. The projectwill be primarily graded on complexity, analysis and documentation.RequirementsThe project should contain the following● ETL - The methods used to fetch and store source data should be clearly outlined andrepeatable. There should be some thought put into the storage format.○ Example - News stories were scraped from 3 webpages hourly using thegetStories.py script. Stories were stored as raw HTML files. The files were thenparsed by parseHTML.py which loaded them into JSON object with the followingschema. I stored the news stories in this JSON schema over MySQL because wewanted flexibility in the schema.● Analysis - What is the primary question you are asking? This might be just an initialquestion which leads into more in depth analysis.○ Example - We looked at the frequency of posts but noticed that the frequencyvaries between two cities of the same size in the same timezone. We then lookedat demographic information to see if there was a correlation.● Two or more data sources - Projects should contain 2 or more data sources. One ofthese “sources” can be an API which translates results.○ Example - I took each post containing a word in our keyword lIA626留学生作业代做、analysis作业代做、Python程序语言作业调试、Python实验作业代写 代写R语言编ist and sent it to anAPI which categorized its popularity score.Waiver of requirementsSome of these requirements can be waived for projects which contain● Custom data visualization● Unique or novel analysis● UI ApplicationIncluded code appendixAll students must supply an appendix of APIs and code they have used.Deliverable content● Summary / initial question● Outline - general approach○ For multi step approaches use diagrams to describe the data flow.● Python code● Figures● Results● Code / API appendixFinal Project - IA626https://docs.google.com/document/u/0/d/1xkoDmsR4IWFpc9iKphMEzhLrNCknRl35B7rHdGn3U50/mobilebasic 12/7/19, 01Q02Page 1 of 2Here are a few data sources and APIs to consider:● Files○ Reddit Comments - 1 month○ Reddit Comments - 1 year (TBD)○ Taxi Trips (see me for complete set)○ Taxi Fares○ NYS Data○ NYC Data● APIs○ Google places API○ Google Geolocation API○ Forecast.io weather API○ Energy data - bulkDeliverable formatProject should be delivered as a PDF including images, figures, code snapshots etc. If yourproject requires another content type please consult me.https://docs.google.com/document/u/0/d/1xkoDmsR4IWFpc9iKphMEzhLrNCknRl35B7rHdGn3U50/mobilebasic 12/7/19, 01Q02Page 2 of 2转自：http://www.daixie0.com/contents/3/4491.html