QB64 Phoenix Edition › QB64 Rising › Code and Stuff › Works in Progress v
Perpetual string math calculator.

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Linear Mode
Perpetual string math calculator.
Pete Offline
Ad-mini-strator
*******
Posts: 2,130
Threads: 212
Joined: Apr 2022
Reputation: 97
#6
08-11-2022, 08:29 PM
(08-11-2022, 12:49 PM)Kernelpanic Wrote: A lot of work, but the rounding was correct. In QB64 it doesn't work with 34,545. The correct result is 34.55 not 34.54. With 34.546 it works correct.

[Image: Rundungsfehler-QB64.jpg]

That's why I coded my string math routine. You simply cannot "count" on binary computer math. (Please enjoy the pun.)

Pete
Find
Reply


Messages In This Thread
Perpetual string math calculator. - by Pete - 08-10-2022, 05:11 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 03:24 AM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 12:39 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 08:29 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 10:08 PM
RE: Perpetual string math calculator. - by bplus - 08-11-2022, 10:07 PM
RE: Perpetual string math calculator. - by Jack - 08-11-2022, 10:35 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 11:35 PM
RE: Perpetual string math calculator. - by Jack - 08-11-2022, 11:42 PM
RE: Perpetual string math calculator. - by Pete - 08-11-2022, 11:51 PM
RE: Perpetual string math calculator. - by Pete - 08-12-2022, 01:56 AM



Users browsing this thread: 25 Guest(s)