import some random files to the database, daily

  • 0
    Just out of curiosity, what kind of files are you importing? Do you manually parsing/editing it to be stored or is it stored like a binary? Does target table/collection/bucket changes or is it same every day?
  • 0
    @hack it's a lot of stuff, we centralize information from the company, and we receive data in all kind of formats. we process everything differently
  • 0
    @darksideofyay stop doing that.

    Have a look at https://nifi.apache.org

    Thank me later.
  • 0
    @NeatNerdPrime unfortunately, it's a very old company and they're very stingy with tech and we can only use stuff from their software center
  • 0
    @darksideofyay "only use stuff from their software center" just have me so much flashbacks when I was in a financial corporate.

    Build experiences, connections, Resume... And jump ship if you have the chance when your financial situation is alright. You'll not regret it.
Add Comment