Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Officially goin out of my mind. Trivial INT problem
#5
Here's the problem, @bert22306 :

Code: (Select All)
x = 35.51
y = x * 100
z = Int(y)
Print Using "######.##############"; x
Print Using "######.##############"; y
Print Using "######.##############"; z

Remember, PRINT rounds and truncates and only displays a maximum of 8 digits or so of your number -- which is why the results format to look like what you'd exoect. PRINT USING, as above, gives you a much more accurate depiction of what the true values of your variables are.

35.51 has no perfect representation in binary math. Multiplying an imperfect representation leads to another imperfect representation.

Everything is working 100% as expected here, even if PRINT, by itself, makes that a little difficult to see and understand.
Reply


Messages In This Thread
RE: Officially goin out of my mind. Trivial INT problem - by SMcNeill - 10-31-2022, 08:19 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Int ( money ) inc 5 439 11-30-2025, 12:45 AM
Last Post: hsiangch_ong
  Big problem for me. MystikShadows 11 1,934 01-16-2025, 05:11 AM
Last Post: JRace
  Problem with "MOD" Kernelpanic 5 1,001 01-06-2025, 02:37 AM
Last Post: Pete
  Problem with _Resize dano 7 1,233 10-22-2024, 07:22 PM
Last Post: dano
  Menu Run (No EXE) Problem GareBear 5 1,144 10-06-2023, 05:41 AM
Last Post: GareBear

Forum Jump:


Users browsing this thread: 1 Guest(s)