+- QB64 Phoenix Edition (https://qb64phoenix.com/forum)
+-- Forum: QB64 Rising (https://qb64phoenix.com/forum/forumdisplay.php?fid=1)
+--- Forum: Code and Stuff (https://qb64phoenix.com/forum/forumdisplay.php?fid=3)
+---- Forum: Help Me! (https://qb64phoenix.com/forum/forumdisplay.php?fid=10)
+---- Thread: need a Scientific Notation to real number converter (/showthread.php?tid=2074)
RE: need a Scientific Notation to real number converter - random1 - 10-20-2023
Bplus
Can you give an example of string math. I thought that was what I was doing by converting
the result from number to string then back to a number. The problem is that when converting
back to a number it also converted back to the notation. This has been killing me, The whole
thing will be removed once I can hand verify that all the calculations are correct. Right now, as
it is the values don't match. I print the values to a plain text file so that I can check everything.
Once I can prove everything is calculating correctly this part will be removed from the the main
code. I could use the notation in my hand calculations but most likely it would increase the odds
of me making mistakes. Speed at this point is not a issue.
Thanks R1
RE: need a Scientific Notation to real number converter - SMcNeill - 10-20-2023
(10-20-2023, 02:35 PM)random1 Wrote: Bplus
Can you give an example of string math. I thought that was what I was doing by converting
the result from number to string then back to a number. The problem is that when converting
back to a number it also converted back to the notation. This has been killing me, The whole
thing will be removed once I can hand verify that all the calculations are correct. Right now, as
it is the values don't match. I print the values to a plain text file so that I can check everything.
Once I can prove everything is calculating correctly this part will be removed from the the main
code. I could use the notation in my hand calculations but most likely it would increase the odds
of me making mistakes. Speed at this point is not a issue.
Thanks R1
https://qb64phoenix.com/forum/showthread.php?tid=787
RE: need a Scientific Notation to real number converter - bplus - 10-20-2023
(10-20-2023, 03:33 PM)SMcNeill Wrote:(10-20-2023, 02:35 PM)random1 Wrote: Bplus
Can you give an example of string math. I thought that was what I was doing by converting
the result from number to string then back to a number. The problem is that when converting
back to a number it also converted back to the notation. This has been killing me, The whole
thing will be removed once I can hand verify that all the calculations are correct. Right now, as
it is the values don't match. I print the values to a plain text file so that I can check everything.
Once I can prove everything is calculating correctly this part will be removed from the the main
code. I could use the notation in my hand calculations but most likely it would increase the odds
of me making mistakes. Speed at this point is not a issue.
Thanks R1
https://qb64phoenix.com/forum/showthread.php?tid=787
Yeah ScNeill's is good example, I did 18 chars per calc too, due to his influence.
RE: need a Scientific Notation to real number converter - SMcNeill - 10-20-2023
@bplus Much better than doing 1 calc per character.
RE: need a Scientific Notation to real number converter - bplus - 10-20-2023
(10-20-2023, 04:52 PM)SMcNeill Wrote: @bplus Much better than doing 1 calc per character.
Yet bet-cha!
@random1 in string math, you never let the numbers you calc with touch QB64 number types they all remain Strings. Remember strings only have a limit of the size memory you have, so in string math the numbers are not limited to any particular and uniform size. For that freedom you pay a price and it may be dear, how long your calculations may take.