Fast QB64 base64 encoder & decoder - a740g - 11-18-2023
This is a Base64 encode, decode, and resource loader library based on MODP_B64, a C-based super-fast Base64 encoder and decoder library.
The library has 4 functions:
Code: (Select All)
''' @brief Converts a normal STRING or binary data to a base64 STRING.
''' @param src The normal STRING or binary data to be converted.
''' @return The base64 STRING.
FUNCTION Base64_Encode$ (src AS STRING)
''' @brief Converts a base64 STRING to a normal STRING or binary data.
''' @param src The base64 STRING to be converted.
''' @return The normal STRING or binary data.
FUNCTION Base64_Decode$ (src AS STRING)
''' @brief Loads a binary file encoded with Bin2Data (CONST).
''' @param src The base64 STRING containing the encoded data.
''' @param ogSize The original size of the data.
''' @param isComp Whether the data is compressed.
''' @return The normal STRING or binary data.
FUNCTION Base64_LoadResourceString$ (src AS STRING, ogSize AS _UNSIGNED LONG, isComp AS _BYTE)
''' @brief Loads a binary file encoded with Bin2Data (DATA).
''' Usage:
''' 1. Encode the binary file with Bin2Data.
''' 2. Include the file or its contents.
''' 3. Load the file like so:
''' Restore label_generated_by_bin2data
''' Dim buffer As String
''' buffer = Base64_LoadResourceData
''' @return The normal STRING or binary data.
FUNCTION Base64_LoadResourceData$
It's much faster than my earlier QB64-only implementation which you can find here: Something Tricky (qb64phoenix.com).
Here are some numbers from my Ryzen 5600X box.
I threw in Win32 API-based Base64 encoder & decoder wrappers for the benchmark. However, the library is cross-platform.
The numbers in the image are with C++ optimizations turned on. However, even with optimizations turned off MODP_B64 runs circles around Win32 and my earlier implementation.
The Bin2Data tool lives here: https://qb64phoenix.com/forum/showthread.php?tid=2228
RE: Fast QB64 base64 encoder & decoder - Dav - 11-18-2023
Nice implementation! And As always your code is polished.
- Dav
RE: Fast QB64 base64 encoder & decoder - SpriggsySpriggs - 11-20-2023
Makes me wonder how fast mine is.
https://qb64forum.alephc.xyz/index.php?topic=3819.msg131690#msg131690
EDIT: Hmm, very slow, also fails to decode the text from LOREM_IPSUM. Very odd. Never had any problems before and it worked with other Base64 strings that I had in the past. Was also a direct copy of a Rosetta task, so the algorithm might not be good. It fails on the "b4" line of the decode$ function.
2nd EDIT: Nice. If I dig up my Win32 version, it is super fast on my PC.
Samuel's algo:
Win32:
Code: (Select All)
Option _Explicit
Const ITERATIONS = 100000
Const LOREM_IPSUM = "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum."
Dim encTxt As String, decTxt As String, i As Long, t As Double
Print ITERATIONS; "iterations,"; Len(LOREM_IPSUM); "bytes."
Print "Base64 encode..."
t = Timer
For i = 1 To ITERATIONS
encTxt = encodeBase64(LOREM_IPSUM)
Next
Print Using "#####.##### seconds"; Timer - t
Print "Base64 decode..."
t = Timer
For i = 1 To ITERATIONS
decTxt = decodeBase64(encTxt)
Next
Print Using "#####.##### seconds"; Timer - t
If _StrCmp(decTxt, LOREM_IPSUM) = 0 Then
Print "Passed"
Else
Print "Failed"
End If
Declare Dynamic Library "Crypt32"
Function CryptBinaryToString& Alias "CryptBinaryToStringA" (ByVal pbBinary As _Offset, Byval cbBinary As Long, Byval dwFlags As Long, Byval pszString As _Offset, Byval pcchString As _Offset)
Function CryptStringToBinary& Alias "CryptStringToBinaryA" (ByVal pszString As _Offset, Byval cchString As Long, Byval dwFlags As Long, Byval pbBinary As _Offset, Byval pcbBinary As _Offset, Byval pdwSkip As _Offset, Byval pdwFlags As _Offset)
End Declare
Function encodeBase64$ (encode As String)
Const CRYPT_STRING_NOCRLF = &H40000000
Const CRYPT_STRING_BASE64 = &H00000001
Dim a As Long
Dim lengthencode As Long
Dim encoded As String
Dim lengthencoded As Long
lengthencode = Len(encode)
a = CryptBinaryToString(_Offset(encode), lengthencode, CRYPT_STRING_BASE64 Or CRYPT_STRING_NOCRLF, 0, _Offset(lengthencoded))
'Calculate buffer length
If a <> 0 Then
encoded = Space$(lengthencoded)
Else
encodeBase64 = ""
Exit Function
End If
a = CryptBinaryToString(_Offset(encode), lengthencode, CRYPT_STRING_BASE64 Or CRYPT_STRING_NOCRLF, _Offset(encoded), _Offset(lengthencoded))
'Acual conversion
If a <> 0 Then
encodeBase64 = encoded
Else
encodeBase64 = ""
End If
End Function
Function decodeBase64$ (decode As String)
Const CRYPT_STRING_BASE64_ANY = &H00000006
Dim a As Long
Dim lengthdecode As Long
Dim decoded As String
Dim lengthdecoded As Long
lengthdecode = Len(decode)
a = CryptStringToBinary(_Offset(decode), lengthdecode, CRYPT_STRING_BASE64_ANY, 0, _Offset(lengthdecoded), 0, 0)
'Calculate buffer length
If a <> 0 Then
decoded = Space$(lengthdecoded)
Else
decodeBase64 = ""
Exit Function
End If
a = CryptStringToBinary(_Offset(decode), lengthdecode, CRYPT_STRING_BASE64_ANY, _Offset(decoded), _Offset(lengthdecoded), 0, 0)
'Actual conversion
If a <> 0 Then
decodeBase64 = decoded
Else
decodeBase64 = ""
End If
End Function
RE: Fast QB64 base64 encoder & decoder - a740g - 12-21-2024
The library is updated with the MODP_B64 based encoder/decoder which gives 3x+ faster encode/decode performance.
Full update and download in the first post.
|