Remove incoming packages from FTP after successful ingest to BCMS
We would like you to remove incoming FTP packages after successful ingest to BCMS.
This impacts "conversion", i.e. packages in:
/convert/xml/word/out/
/convert/xml/book/out/
/convert/xml/chapter/out/And it impacts "FTP submissions", i.e.
/submit/*/These are packages called out as package in the submit_apex_package_receipt and submit_package_receipt Kafka notifications.
It's important to remove the packages at the very last step, after successful ingest.
Rationale: The FTP site is not intended to be permanent storage: we will run out of space if we let too much pile up. We also discussed cleaning the FTP NCBI-side, but decided that removal immediately following successful load to BCMS is the best option.
cc @Kireev