Skip to content

this script is used to load parquet data into postgress database using spark.

Notifications You must be signed in to change notification settings

itsrcx/spark-python-script

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spark-python-script

this python script is used to load parquet data into postgress database using pyspark.

  • provides jar file and script shold be in same folder. (If you want to use other version of JDBC change it in script too.)
  • run python p2p_script.py -h for usage.
  • when script is succcessfull, message: Script completed successfully! Data loaded.
  • enjoy!

Screenshots

About

this script is used to load parquet data into postgress database using spark.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages