The information from the website is correct, 0.1 is the latest release, but the code has moved on since then. I have personally made hundreds of commits since then.
The reason for not using Apple's CF-Lite is historic and technical. First, CoreBase was originally implemented completely on top of Base, making it essentially a C wrapper around Objective-C code. The original goal of the project was to provide the easiest path possible to port WebKit to GNUstep. This is still a major goal for the project, but due to some of the inherit characteristics of CF objects I've decided to implement everything in pure C to reduce overhead and allow more flexibility.
Second, CF-Lite only supports a very narrow superset of C. For example, Blocks are required and GCC does not provide it. Additionally, CoreBase needs to be portable to more platforms than CF-Lite. I've tried compiling CF-Lite on a few different platforms (Windows and Linux to be specific) in the past and it was disastrous.
Third, Apple license is not compatible with the GPL, and GNUstep being a GNU project, this become a bit of a problem (
). Base and CoreBase share quite a bit of code, as I was the one who wrote some of the ICU dependent portions of Base and later ported it to CoreBase.