- Added StringTable class. The StringTable class differs from the StringArray class in that it’s intended to hold a table of strings that is mostly read-only. The internal storage of all the strings is in a single contiguous block of memory for efficient (minimized) memory storage.
- Expanded the BinData class by adding new methods and making it available in all programming languages.
- Expanded the StringBuilder class by adding many more methods.
- Note: BinData and StringBuilder are consistently the same across all programming languages, whereas CkString and CkByteData are not. CkString and CkByteData will continue to be used in future versions, are still an integral part of Chilkat, and are NOT deprecated.
- Note: One use of BinData and StringBuilder is in use of new methods ending in “Sb” and “Bd”. These methods are for returning or passing text or binary data, especially large amounts of text or data. For example, imagine one Chilkat method is used to retrieve a large amount of data, and then that data is passed to another Chilkat method. A large waste of time and memory is consumed in returning the string (or binary bytes) to the programming language, and then immediately passing it back to Chilkat. If it is .NET, then the data must be marshaled from unmanaged to managed, and then, to pass back to Chilkat it is marshaled from managed to unmanaged. The same applies when using the ActiveX (with BSTR’s and Variants). By retrieving results directly into a BinData or StringBuilder, and then passing the data by passing the object, the data stays on the native side. For example, the new Rest.ReadRespSb method reads the REST response directly in to a StringBuilder. If it is JSON, this can be loaded directly into a JsonObject via the JsonObject.LoadSb. In the future, new “Sb” and “Bd” methods will be added in places where large amounts of data are likely to be encountered. This will create pathways allowing data to stay native as much as possible.
Version 126.96.36.199 adds the following initial set of Sb/Bd methods:
- SshTunnel – Now automatically keeps the SSH connection alive during idle times by sending IGNORE messages every 20 seconds (when idle).
- The 32-bit .NET VS2015 build now uses the /LARGEADDRESSAWARE linker option. (See /LARGEADDRESSAWARE)
- Minor CSV fix where the last line in a CSV file was inadvertently being trimmed of whitespace on both ends.
- Added the Global.UnlockStatus property to allow applications to programmatically know if the UnlockBundle (or UnlockComponent) method call succeeded because of the 30-day trial or a recognized/purchased unlock code.
- Rest – allows Basic authentication for non-secure connections to localhost. Normally, Chilkat disallows the Basic authentication method if the connection is not TLS. There is one exception now, and that is for connections to localhost.
Added a C# project on GitHub to demonstrate async sockets: C# Async Sockets
- REST: The FullRequestFormUrlEncoded method did not work correctly with AWS authentication. This was fixed. (Note: This fix is required for using Amazon SES to send email.)
- TLS on Big Endian Machines: Fixed TLS connection issue with some cipher suites on Big Endian machines. There was a particular internal piece of code that did not properly account for the endianness of the machine and assume little endian (which is by far the most common byte ordering).
- FTP2: The “m”, “d”, and “y” XML attributes in the XML result returned by GetXmlDirListing were mixed up. (For example: full=”20160929-100512″ m=”2016″ d=”9″ y=”29″ hh=”10″ mm=”5″ ss=”12″) This was fixed.
- SFTP: The ReadFileBytes method could hang for duration of IdleTimeoutMs if file size was smaller than number of bytes requested. This was fixed.
- SshTunnel: Added the IsSshConnected method.
- SshTunnel: Added internal functionality to periodically send IGNORE messages to the SSH server to keep the connection alive when the clients are inactive.
- BinData: The BinData object was previously specific to the ActiveX. It is now available across all programming languages. The BinData object duplicates some of the functionality of CkByteData, but CkByteData is specific to some programming languages.
- ActiveX, .NET: Fixed problems with the LastMethodSuccess property. Version 188.8.131.52 is a patch for .NET and ActiveX only for this one issue. The Mono builds, .NET Core, and .NET UWP (Windows Runtime) did not have any problem with LastMethodSuccess, and therefore remain at v184.108.40.206. Other languages (C++, Java, Perl, Python, etc.) are also unaffected and therefore remain at v220.127.116.11.
- OAuth2: Added the OAuth2 class.
- FTP2: Fixed SyncRemoteTree/SyncRemoteTree2 progress monitoring callbacks.
- Crypt2: Fixed the GenerateUuid to respect RFC 4122. The GenerateUuid method generates the version 4 variant, which is composed of entirely random data except for the few bits that signify version 4.
- Compression: Fixed the CompressFile method for large files. See Fixed CompressFile
- MHT: Fixed: MS-Word html files with %20 in file paths needed to be replaced with SPACE chars.
- Cert/SMIME/PKCS7: Fixed: When a cert doesn’t have the Issuer CN, the encrypted message could not be decrypted using Chilkat library, even though the cert does have subject key id.
- REST: Dropbox workaround: DropBox is not Q/B decoding header fields as it should do (if it were
behaving according to standards). Two modifications were made: (1) Disable Q/B encoding for header fields when Dropbox is the endpoint. (2) Added a new REST property named AllowHeaderQB to enable/disable Q/B encoding for header fields. It is enabled by default.
- SSH: Fixed: ChannelReceiveUntilMatch did not work for some cases with wildcard (*) match patterns.
- Android/Java: Fixed the emoji utf-8 problem. The use of emoji’s caused issues with the underlying JNI implementation because Java uses modified-utf8, which is only different because it must use surrogate pairs for chars that encode to longer than 3 bytes. Chilkat will now (internally) emit the correct modified utf-8 using surrogate pairs to keep the JNI fat and happy (given that this problem was discovered w/ the pizza slice emoji for a major pizza chain).
- HTTP/TrustedRoots: Fixed: When verifying the web server certificate for a TLS connection, the Windows registry-based root CA cert stores were not being searched when TrustSystemCaRoots was true.
Now Chilkat will correctly search for the root cert, and if found, will trust the root cert.
- PEM: Added the “AddItem” method. See the very bottom of this example: AddItem
- MHT: Enhancement: MHT will not try to embed images when the data is already embedded, such as:
<img style=”display:block;margin:0 auto 5px;text-align:center;” src=”data:image/png;base64,iVBORw0KGg…
- HTTP: Fixed auto-follow of HTTP redirects when the redirect URL is a Protocol-relative_URL (i.e. URLs beginning with “//”)
- Zip: Added the AppendDataEncoded method.
- Python/FreeBSD: Fixed the installer for Python on FreeBSD.
- Email: Fixed Q/B decoding issue for address related headers. The SPACE char between the friendly name and the email address was dropped when Q/B decoding.
- JSON: Fixed a parse problem that occurred when a Unicode char was the very last char in a JSON value string. For example if the value string ended with “\\u6e2c”, then this final char was dropped in the string returned by various methods.
- TLS 1.2: Fixed: The server would close the TLS connection during initial handshake (after receiving the ClientHello) if it picked the cipher suite TLS_ECDHE_ECDSA in TLS 1.2. The reason is that Chilkat did not include the ECDSA/SHA1 signature hash algorithm as a candidate for the Server Key Exchange. (Note: This was not a security issue — it was just a case where the TLS handshake would fail if the server picked a particular cipher suite, only in TLS 1.2, and expected to use a paricular Server Key Exchange signature hash algorithm.)
- SSH: Added the hmac-sha1-96 algorithm to what is supported in the internal SSH connection protocol.
- Email: Eliminated problems arising from X.400 email addresses where there is no “@” character.
- HTTP: Fixed the ReceiveRate callback (so that it’s actually called) for the WinRT and Unicode C++ builds.
- Unicode C++: Event callbacks were broken starting in v18.104.22.168 for the Unicode C++ builds. (They were working in v22.214.171.124, broken in .58, and now fixed in .59)
- IMAP: A particular kind of email on a particular IMAP server would cause a hang (or timeout) when downloading the email for the case where AutoDownloadAttachments is disabled.
- SFTP: Worked around problems with the Devart SSH server.
- Email: Fixed email structure problems for certain situations when SetHtmlBody was called.
- HTTP/S3: Fixed a problem caused when filenames contain SPACE chars.
- Email: The ComputeGlobalKey method was deprecated and should not be used. The inputs to the MD5 hash algorithm were not properly canonicalized, and therefore the computed key could change from version to version (based on fixes, improvements, etc. in the MIME processing).
- Email: Added the ComputeGlobalKey2 method, which is properly canonicalized to avoid the issues of the original ComputeGlobalKey implementation.
- XMP: Fixed: TIFF files with EXIF IFD’s were not correctly re-written.
- Email/MIME: Fixed problems where the values in address related header fields were not returned Q/B decoded. (For example, the value returned by the GetHeaderField method should be Q/B decoded.)
- SSH: Fixed a performance problem w/ the ChannelPoll method for very small timeouts.
- Zip: Fixed a problem w/ encrypted zips for Unicode C++ (CkZipW) on Mac OS X. The issue has to do with the fact that wchar_t is 4 bytes per char (on Mac OS X) as opposed to 2 bytes per char.
- Email: Fixed GetSignedByCert so that it will still return the certificate even if the signature validation fails.
- FTPS: Fixed a PBSZ/”PROT P” problem with the Global eXchange Services Secure FTP brand of FTP server.
- JSON: Fixed a JSON parsing problem having to do with escaped chars.
- MHT: Fixed a problem with “link” tags where attributes such as “media” were getting dropped.
Here are C# and VB.NET sample applications (on GitHub) for doing OAuth2 authorization using Chilkat for Facebook, Google, LinkedIn, Salesforce, and GitHub.
One particular cause of the following error is finally known:
sockRecv(47ms): WindowsError: An existing connection was forcibly closed by the remote host. WindowsErrorCode: 0x2746 numBytesRequested: 5 Failed to receive data on the TCP socket --sockRecv sockRecv failed. sockRecvN_buf: Did not receive the exact number of bytes desired. numBytesToReceive: 5
This error was caused by the Windows Firewall doing stateful FTP filtering. The solution is to disable stateful FTP filtering so that the firewall does not block any FTP traffic. (This is typically prescribed for the server-side of FTP, but it also applies to the client-side.)
Note: The Windows Firewall’s stateful FTP filtering only causes problems when the connection is SSL/TLS. Clear (non-secured) connections are not affected.
To disable stateful FTP filtering, open an administrative command prompt, and type the following:
netsh advfirewall set global StatefulFTP disable
Also Note: The above error could also be a result of the connection truly being closed by the remote host, or something on the server-side. This solution only applies to the case where Windows Firewall (on the client-side computer) is interfering with a SSL/TLS FTP connection.
How to Reproduce the Problem
To reproduce the problem, write a program that establishes a TLS connection with an FTP server. After authenticating, write a simple loop that calls ftp.Noop 1500 times. If Windows Firewall is interfering, it is likely to fail in the same place every time. For example, in my case the error occurs on iteration 699 every time.
Also, the error may not be easily reproducible even if Windows Firewall is a problem. For example, the problem seemed to be not reproducible if the FTP server was not a Windows-hosted FTP server. One might suspect the server-side to be the problem, but the connection reset ([RST, ACK] in a WireShark trace) definitely originated from the client-side.
Disabling the firewall’s Stateful Packet Inspection (SPI) feature solved the problem every time. (It should be the case that stateful packet inspection should NEVER try to inspect the packets of a TLS encrypted channel for the simple fact that it’s impossible to inspect. The firewall does not have the ability to decrypt the packets in the channel, and therefore it cannot inspect anything. The firewall’s only choices SHOULD be to simply allow or disallow the connection. I don’t understand why stateful packet inspection should ever be “monkeying around” with encrypted channels..)
- Rest: Added the Rest class.
- Jwt: Added the Jwt class.
- AuthAws: Added the AuthAws class.
- AuthGoogle: Added the AuthGoogle class.
- AuthAzureAD: Added the AuthAzureAD class.
- AuthAzureStorage: Added the AuthAzureStorage class.
- ServerSentEvent: Added the ServerSentEvent class.
- CertStore: Fixed a memory leak in the LoadPemFile method.
- Charset: Fixed problems in the VerifyData method having to do with us-ascii and utf-8.
- C++: Now includes utf16_t classes. Except for certain classes such as CkString and CkByteData, there are three options for each C++ class:
the multibyte class, the wchar_t class, and the utf16_t class. For example, CkSFtp, CkSFtpW, and CkSFtpU.
- FTP2: (FIXED) The SyncRemoteTree/SyncRemoteTree2 progress monitoring (event callbacks) were not working
- FTP2: Added the LargeFileUpload method.
- IMAP: Added new methods: HasCapability, GetQuotaRoot, GetQuota, and SetQuota.
- LastErrorText: The Windows logged-on username is no longer automatically logged at the top of every LastErrorText.
(This was originally done to help w/ support issues so tht Chilkat might notice if the program runs in the context of a Service or IIS, which could be a clue to the cause of certain problems.)
- SSL/TLS: Internal client-side and server-side renegotiate problems were fixed.
- FTP2: Backslash chars in paths sent to the server are automatically converted to forward-slashes
- PrivateKey/PublicKey: Deprecated many methods and added new methods. Originally these classes were for RSA keys, but have since become
a classes that can contain either RSA, DSA, or ECC keys. Methods with “RSA” in the name were deprecated. Also, methods with confusing names were deprecated and replaced with methods having better names.
- SFTP: Fixed problems with certain SSH/SFTP servers where certain downloads would hang.
- TLS: Added support for the SHA512 server key exchange hash algorithm. (See http://www.chilkatforum.com/questions/10395/sslallowedciphers-options)
- StringBuilder: Added a StringBuilder class, which is more helpful in some older programming languages as opposed to others.
- Email: Fixed problems with comma characters found in email addresses that are Q/B encoded.
- JsonObject: Crash bug fixed in the StringOf method.
- Email: (FIXED) Comma characters embedded in an email address friendly name, such as “Doug, Smith ” would interfere with the parsing of the email address.
- SFTP: Added the SyncDirectives property.
- LoadTaskResult: (FIXED) The ActiveX LoadTaskResult methods always returned 0, regardless of success/failure.
- MHT: (FIXED) Chilkat hangs with specific HTML on calling mht.GetEML. The problem had to do with infinite recursion: The CSS that is downloaded itself contained an import for the same CSS (or indirectly contained an import for a CSS that then contained an import for a CSS that was previously downloaded, causing a loop).
- Crypt2: The value of the KeyLength property should always be in agreement with the number of bytes of key material provided by the application.
The SetEncodedKey method correctly has the side-effect of also setting the KeyLength property. However, setting the SecretKey property directly did not also have this desired side-effect.
This was fixed. If the SecretKey property is set with 16 bytes of data (128 bits) then the KeyLength property is automatically updated to 128.
- PHP: Added Windows builds for PHP as FastCGI with IIS using the Non-Thread Safe (NTS) versions of PHP. See https://www.chilkatsoft.com/php.asp
- Tar: Fixed a crash bug in the VerifyTar method (for corrupt/garbage input files).
- CkDateTime: added the GetAsTimestamp and SetFromTimestamp methods.
- Email: Fixed issues having to do with structuring an email with multipart/related, multipart/alternative, etc.
- Ftp2: Regarding the ForceIpAddress property: By default, Chilkat will NOT try to bind the data socket to the IP address specified by the ForceIpAddress property.
You may use a special “bind-” prefix in the ForceIpAddress property to cause the data socket to be bound to the ForceIpAddress property. For example, put_ForceIpAddress(“bind-126.96.36.199”)
There was an undocumented feature where you can set the ForceIpAddress property equal to the keyword “control”. In this case, the IP address of the control connection is used.
Also, Chilkat will now recognize the error message “I won’t open a connection to…”, and will automatically retry using the IP address from the message.
- Csv: (FIXED) Csv.WriteFile2 did not work with utf-16.
- CkString (C++): Added getUtf16 and setStringUtf16 methods.
- IMAP/MailMan: (FIXED) The new format of the IMAP-only unlock code unloced IMAP, but not the MailMan object.
- AbortCurrent: Added the AbortCurrent property to classes that can have event callbacks.
- HTTP: Fixed a problem involving HTTP redirect responses in combination with HTTP proxies where both SSL/TLS and non-SSL/TLS URLs are involved.
- IMAP: Added the capability to handle DIGEST-MD5 authentication for IMAP.
- HTTP: Fixed problems handling 407 responses. Also fixed behavior when receiving a response with a “proxy-connection:close” header.
- SshKey: (FIXED) SshKey.FromPuttyPrivateKey() failed if comment contained umlauts. See
- JsonObject: (FIXED) Calling json.AddObjectAt on an empty JSON document failed.
- FTP2: Reverted the Microsoft FTP workaround added to v188.8.131.52.
- Socket: The non-SSL/TLS HTTP proxy functionality was fixed.
- SCP: The DownloadFile method did not close the channel.
There is often alarm at the size of the Chilkat static libraries (.a) for iOS. This should not be of too much concern, because after building your app in Release mode, your app’s executable will NOT grow by the size of the static library. It will only grow by a very small fraction of the total size of the .a
There are some common misunderstandings about static libraries that should be cleared up.
- You do NOT include the static library (.a) in the package you submit to the app store.
- When building your program, Xcode only pulls in the library code that is directly or indirectly used. (This is true for any C/C++ linker.) If, for example, Chilkat added functionality for SNMP, Jabber, and Bitcoin, and if this new code caused growth in the .a by 100MB, then it would only cause an increase in your app’s size if your app actually uses the new code.
- You may be unaware of the vast number of already-existing system libs (.a) and the vast sizes if all of these were summed up. Obviously, these are not included in their entirety in your app’s executable. The same applies to the Chilkat static libs.
- You can always check to see how much your app’s executable actually grows in size after linking with Chilkat by examining the size of the executable after linking.
- The Chilkat universal lib is composed of both the simulator static libs (x86 + x86_64), and the device libs (arm64, armv7, armv7s). Your application built for the App Store would not be including alternatives for the simulator.
- This Apple Technical Q&A discusses general techniques for reducing the size of an app: https://developer.apple.com/library/ios/qa/qa1795/_index.html