Skip to main content

CSV Parsing with Scala

Good new about Scala is, actually not only about Scala but all other JVM based languages is that they can take advantages of Java libraries. Since the Scala is a JVM based programming language its easy to use Java libraries and classes with it.

I needed to parse complex CSV file with Scala and create MongoDB object to represent an each row of the CSV file. This would have been easy if I was asked to create MongoDB objects using a JSON file because the JSON is highly supported by the MongoDB. But here I only got complex CSV file with loads of data. First I found some good tutorial about Scala CSV parsing and started my work.

Yes I'm using Play framework 2.0.2 with Scala and MongoDB. I found opencsv is the best solution for parsing CSV files with Scala. Opencsv is for Java but as we already know that Scala is a JVM based language we can go with it.

First I updated my build configuration file to reflect the application dependencies for opencsv.

add this dependencies to your config file. 
"net.sf.opencsv" % "opencsv" % "2.1"
This will download the dependent jar files to your repository. You should close eclipse and compile the project and you can see that dependencies are downloaded.

Comments

Post a Comment

Popular posts from this blog

Upload CSV file using opencsv with Play 2.0.2, Scala and MongoDB

Hi Everyone... Today I'm going to explain you that how we could upload a CSV file with list of products to the MongoDB table. The way I'm describing here might me inefficient but still it is useful. We know that Scala is running on JVM and so that we can use any java library with Scala . I will use OpenCSV as a CSV parser for this program. OpenCSV is a CSV parser library for Java. No matter it is for java here we will use it with Scala. First we should have MongoDB up and running. Include following opencsv dependency in your build file. I'm using SBT as building tool. "net.sf.opencsv" % "opencsv" % "2.1" Here next I will create view file. Name of this file will be 'index.scala.html'. @(message: String)(implicit request: RequestHeader, flash:Flash, l: Lang=Lang("en")) @import play.api.i18n._ @import views.html.helper._ @main(message, null) { //print messages @if(flash.data.contains("message")){ ...
1 comment
Read more

How to save Large html(data) content with Play framewrok, MongoDB and Scala

Hi all, While I was working on a project I had to save large content of data from text area filed in a form. I'm using Play Framework 2.0.2 as a web framework and using scala html templates as views. I have text area filed in my form to add html data (Actually here I'm using ace.js   that is high quality code editor. Ill give brief introduction to ace later). Ok Here I do not post form binding with model class but just think that there is a simple model class lets say Page. Most important thing is the saving part of this program. Here I have posted my save definition(function). def save = Action(parse.urlFormEncoded(maxLength = 1024 * 1000))  { implicit request =           //More code goes here.. I have not posted           Page.save(pageForm)           Redirect(Pages.show(        ...
Post a Comment
Read more

Feedburner depricated.

Hi guys, Today I faced a big problem with Google's feedburner API. Yes that is true that Google has announced that feedburner API is deprecated. http://code.google.com/apis/feedburner/ . But I think it should not mean that its existing way of doing is not stopped. I was using feedburner from couple of months before to feed some rss feeds to a twitter account. From the feedburner they have given excellent API to do this. Actually this was excellent. It functioned really well till 2012-02-22. But today I wanted to modify some of my feeds and logged into my feedburner account and found Socialize menu was missed from the Publicize menu. I could not do anything. I did not try to get support from google becase this post. http://groups.google.com/group/feedburner-statistics/browse_thread/thread/6d5c8d8131ba0936 Only I have to do is finding another good API like feedburner.
Post a Comment
Read more