What is data processing?

What are the pros/cons of Python vs. Processing for a data collection and graphing project in a small cheesemaking plant?

  • Rapid development is important. Familiarity with either language isn't a factor. Ideally, I would like to deploy the data collection and graphing on a raspberry pi with a wall-mounted display. I'll be using XBee modules for the sensor network. Seems that processing might be easier to do the graphics, but I haven't done a project like this in either language. Alternative suggestions welcome.

  • Answer:

    A cool use case, for sure. One route would be to log, stream, and graph the data from your RasPi in your browser via the Plotly Python API (https://plot.ly/api/python). A Plotly user did that this week with temperature (disclosure: I work there). You can  fork the code here: https://github.com/jensb89/PiTemp and see the graph here: https://plot.ly/~jensb89/12/. Once you've generated your graph, you can embed it as an iframe with this snippet: <iframe id="igraph" src="https://plot.ly/~abhishek.mitra.963/1/400/250/" width="400" height="250" seamless="seamless" scrolling="no"></iframe> You'll want to swap in your URL that snippet. Let me know if you have any issues or I can help with anything. Here's how it looks:

Mateo Sanchez at Quora Visit the source

Was this solution helpful to you?

Other answers

Python is indisputably better at data parsing and manipulation. Processing is far better at quick, clean, beautiful data representation. I'd recommend using an approach that uses python to parse and organize data in a format that is comfortable to import and parse into processing (xml,json,csv), and then a separate processing sketch to take that data and display it. I've used this approach before fairly successfully. This modular approach might make what you eventually create a bit more portable if you'd like to use it for other projects as well.

Aurimas Matas Bukauskas

Presumably you have the data in a database.  You can use Python or php for interacting with the database.  As for graphing, I would use Javascript or jQuery (if you cannot control the browser choice) for graphing and presentation.  There are literally dozens of sophisticated and well done libraries to accomplish all of these tasks.  Whether you use php or python to interact with the database, I cannot advise you, because of my lack of familiarity with your project.  As for the Pi, my advice to you is to make sure that your data requirements and speed are not too big to overrun the Pi. The Pi is a new machine, without industrial application history.  I would be comfortable using it to acquire data from sensors, but would be skeptical about its ability to simultaneously collect data, manage the database, and display any sort of sophisticated interactive graphics simultaneously.  I would also be leery of using the Pi to collect data in an industrial fail-safe environment.  It wasn't built for that! One of my cardinal rules is to avoid being a pioneer - especially in the area of using experimental platforms and machines in an ongoing business venture.  It's almost ALWAYS better to let others fall on their swords.  Let the technology become proven before you go risking your reputation on untried technology. I have 4 Pi s I use myself for experimentation, but I would never consider using them for a critical business project.  I advise you to remember that they were designed to allow students a low cost entry to computing.  They have limited ram and memory, and little redundancy.  They don't even have a clock!  Stay for a while with reliable stable technology until more software becomes available for your Pi. Verbum sapienti satis est.

Chris Kemp

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.