Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Performance improvement splitting huge file
#10
This is for an exceptionlog of millions of smartmeters processing minute-readings. (~10 GB / hour)
Once every hour these loglines need to be split per energy-provider ( ~20) to be processed in parallel by different systems.

In short term it is too difficult to have the logprovider already split them up when creating (future scenario) so we need this for the time being

I love to do these temporary utilities in QB64 :-)
45y and 2M lines of MBASIC>BASICA>QBASIC>QBX>QB64 experience
Reply


Messages In This Thread
RE: Performance improvement splitting huge file - by mdijkens - 10-23-2023, 12:26 PM



Users browsing this thread: 1 Guest(s)