Skip to content
This repository has been archived by the owner on Dec 15, 2021. It is now read-only.

kasramp/sample-spark-java

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Sample Spark Java

A simple working example of Spark with Java.

Tutorial

How to run

Bring up docker and create table

$ docker-compose up -d
$ ./db_initializer.sh

Compile and run with Maven

$ cd .. && mvn clean compile exec:java

First 3 million records test rows inserted to the database. Then Sparks read those records and convert them to JSON in books_json directory.