PearlJam-Back-Office

Batch service for PearlJam
Batch using to implement PEARLJAM DB from xml files.

Requirements

For building and running the application you need:

• JDK 1.11
• Maven 3

Install and excute unit tests and ent-to-end tests

Use the maven clean and maven install

mvn clean install

Running batch

Use the folowing cmd :

echo $@
java8 -Xms64m -Xmx512m -classpath '/path/to/lib/*' -Dlog4j.configurationFile=file:/path/to/log4j2.xml -Dproperties.path=/path/to/properties -DcheminLog=/path/to/properties log fr.insee.pearljam.batch.Lanceur $@
CODE_ERREUR=$? [DELETECAMPAIGN] || [LOADCAMPAIGN] || [LOADCONTEXT] || [DAILYUPDATE] || [SYNCHRONIZE] || [SAMPLEPROCESSING])
echo "CODE ERREUR=$CODE_ERREUR"
exit $CODE_ERREUR

Properties file

Some properties are externalized in ${path.properties}/pearljam-bo.properties.
Bellow, properties to define :

fr.insee.pearljam.persistence.database.host = localhost
fr.insee.pearljam.persistence.database.port = 5433
fr.insee.pearljam.persistence.database.schema = XXXXXXXX
fr.insee.pearljam.persistence.database.user = XXXXXXXX
fr.insee.pearljam.persistence.database.password = XXXXXXXX
fr.insee.pearljam.persistence.database.driver = org.postgresql.Driver
fr.insee.pearljam.folder.in=path/to/in
fr.insee.pearljam.folder.out=path/to/out
fr.insee.pearljam.folder.queen.in=path/to/in
fr.insee.pearljam.folder.queen.out=path/to/out

# Context referential URL
fr.insee.pearljam.context.referential.service.url.scheme=http
fr.insee.pearljam.context.referential.service.url.host=localhost
fr.insee.pearljam.context.referential.service.url.port=8080
fr.insee.pearljam.context.referential.service.url.path=/XXXXXXXX

#Maximum number of SU reaffected to an other interviewer during synchronization
fr.insee.pearljam.context.synchronization.interviewers.reaffectation.threshold.absolute=2
#Maximum percentage SU reaffected to an other interviewer / SU processed during synchronization
fr.insee.pearljam.context.synchronization.interviewers.reaffectation.threshold.relative=50
#Maximum number of SU reaffected to an other OU during synchronization
fr.insee.pearljam.context.synchronization.organization.reaffectation.threshold.absolute=2
#Maximum percentage SU reaffected to an other OU / SU processed during synchronization
fr.insee.pearljam.context.synchronization.organization.reaffectation.threshold.relative=50


#Keycloak configuration
keycloak.auth-server-url=http://localhost:8180/auth
keycloak.realm=XXX
keycloak.client.id=XXX
keycloak.client.secret=XXXXXX

# Log created and updated elements in the result file? ( YES | NO | IN_SEPARATE_FILE )
fr.insee.pearljam.context.synchronization.log.elements=YES

# Queen-batch configuration
fr.insee.queen.application.persistenceType=JPA

fr.insee.queen.persistence.database.host = localhost
fr.insee.queen.persistence.database.port = 5432
fr.insee.queen.persistence.database.schema = XXXXXXXX
fr.insee.queen.persistence.database.user = XXXXXXXX
fr.insee.queen.persistence.database.password = XXXXXXXX
fr.insee.queen.persistence.database.driver = org.postgresql.Driver

fr.insee.queen.key.paradata.id=idSu
fr.insee.queen.key.paradata.events=events

Before you commit

Before committing code please ensure,
1 - README.md is updated
2 - A successful build is run and all tests are sucessful
3 - All newly implemented APIs are documented
4 - All newly added properties are documented

Libraries used

• spring-core
• spring-jdbc
• spring-oxm
• spring-data-jpa
• spring-web
• commons-lang3
• postgresql
• liquibase
• spring-test
• test-containers
• json-simple
• jackson-core
• jackson-databind
• log4j

Developers

• Benjamin Claudel ([email protected])
• Samuel Corcaud ([email protected])
• Paul Guillemet ([email protected])