What are the typical sources for data visualizations of web data?
-
Like usage for: Quora, Google, Youtube, Facebook, Twitter. I'm remotely aware of something that some of these sites have APIs, that can be used for extracting data but are not exclusively for that purpose (?). If not, it seems that you could write a data crawler to draw a certain subset of data. Do these crawlers tend to ignore the robots.txt file but try to spread out their requests to be considerate (and not get blocked?) And if the site has an API, do they allow you to make unlimited requests for your data needs? Generally quite confused. Any detailed explanation of some subset v. welcome, and links to websites/tutorials too!
-
Answer:
I've had a number of conversations in our Thought Leaders in http://www.sramanamitra.com/big-data/ series of interviews on the http://1mby1m.com blog all of which point to the fact that data visualization is currently an open area without sufficiently good solutions. Nonetheless, here is a good starting point for your investigation: http://www.sramanamitra.com/2013/01/14/thought-leaders-in-big-data-interview-with-stew-langille-ceo-of-visual-ly-part-1/
Sramana Mitra at Quora Visit the source
Other answers
It sounds like you need a way to get data from websites to make Visualizations with. Here is a video showing you EXACTLY how its done 'step by step' by Jewel Lowree from Tableau using http://import.io (were I work) : There is no need to worry about the technical aspects like request rates etc.. is already done for you. When A website does have an API, I'd encourage you to use if possible. The more API's there are on the web the better! They will have documentation about limits and things like that, which will be different for each API
Daniel Cave
Related Q & A:
- What are some good "beginner level" data modeling/analytics approaches to kick start a data science/analytics team?Best solution by Quora
- What's a typical saturday job?Best solution by Yahoo! Answers
- What is preschool like in Asia? What is a typical day?Best solution by culturequest.us
- What's the typical day of a Paralegal?Best solution by youtube.com
- What is a typical cell phone number in America like?
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.