Change how log outputs are stored and handled

[rahmans1]

Is your feature request related to a problem? Please describe.
Right now, we write 4 log outputs per job to the JLAB xrootd using token based authentication. The work directory will be retired and we cannot store so many small files via rucio in the new lustre system.

Describe the solution you'd like
May be we can add the logs to the reconstructed root files outputs themselves but we need to think about this

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

[panta-123]

Is the logging standarized? like what format and is the format consistent ?
May be we can send the logs to message queue service and then store it in elasticsearch. Have a policy in elasticsearch to delete index before x days/months.