Most efficient way to build a big variable length string?

[mdijkens]

Thanks for the suggestions!


I like the idea of an array of shorter strings; much easier and quicker to work with.
But in the end I'd still need to put them all together in one big string which is very slow with over 10mln pieces

I did experiment with the _MEM(sql$) but the PUT #1, , LEFT$(sql, mpos) still makes a copy in memory.

I didn't think of  MID$(sql$, mpos) = MID$(sql$, mpos+1)
Very nice! It saves at least copying half the string!

Converting/merging/processing big files/databases is a bit of my thing with qb64pe. I've already created lots of very fast functions to handle big data.
So if there are no better options for above challenges, I can live with that but sometimes it's a small things that makes a big difference 

Thanks again for thinking with me