Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Performance improvement splitting huge file
#3
Sorry bplus, but I do need to split.

This snippet is part of a much bigger complex process where I split input to be parallel-processed on different servers
The input has different record-types (in the snippet just bytes) that need processing on specific servers

This approach works but is slow
Also because of variable strings, I can only process in chunks of max 2GB
45y and 2M lines of MBASIC>BASICA>QBASIC>QBX>QB64 experience
Reply


Messages In This Thread
RE: Performance improvement splitting huge file - by mdijkens - 10-21-2023, 02:33 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  performance drop on LINUX with PSET in v4.2 Herve 12 970 11-20-2025, 02:00 PM
Last Post: SpriggsySpriggs
  for performance, what's the best variable type to use for boolean _TRUE & _FALSE ? madscijr 12 1,256 09-29-2025, 02:59 PM
Last Post: dakra137

Forum Jump:


Users browsing this thread: 1 Guest(s)