Whenever there is an SSH, there is a way
As a Data Analyst in a Big-Data project, you should be able to face new challenges everyday. This project was an instance of my daily challenges to make data integrations between our platform and some data sources which does not covered by our data collector.
The figure below is the classic flow of doing the task, before the automation of mine:
After the implementation of the automatiion, the process enhanced like below:
Detail of procedure elaborated in the explanation video.
And also implementation is accessible at this repositorty.