Change of persistent repo in MiNiFi C++

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Change of persistent repo in MiNiFi C++

Marc Parisi
Hello,
 In preparation of solidifying some of our persistent storage code we've
moved from LevelDB to RocksDB as the default persistent storage mechanism.
There should be little change for you other than the installation of
RocksDB. The net benefit will be improved reliability and maintainability
of the dependency's code base.

If you do not wish to install this dependency or your distro doesn't have
RocksDB available in a public repo, our build process will use the version
provided in the third party directory and include the library into the
static library. This will not install RocksDB, but will increase build
times when RocksDB needs to be rebuilt. It is advised that you install
RocksDB from source or your distro's public repos.

To install RocksDB

Ubuntu

sudo apt-get install librocksdb4.1 librocksdb-dev

MacOSX

brew install rocksdb

For CENTOS there does not appear to be a public repo with RocksDB, so
please follow the instructions the RocksDB install to install it
permanently and avoid long build times.

https://github.com/facebook/rocksdb/blob/master/INSTALL.md

Finally, if you wish to avoid using system libraries and build our version
of RocksDB, you can always specify BUILD_ROCKSDB=ON as a variable to CMAKE.
You can also DISABLE_ROCKSDB , but this will default to using volatile
repositories.
Please let me know if you have any questions.
Marc
Reply | Threaded
Open this post in threaded view
|

Re: Change of persistent repo in MiNiFi C++

Andy Christianson-2
Mark,

Nice work on the port to RocksDB. Are there any positive/negative runtime performance or resource usage implications of the change?

Regards,

Andy

On 10/17/17, 1:28 PM, "Marc" <[hidden email]> wrote:

    Hello,
     In preparation of solidifying some of our persistent storage code we've
    moved from LevelDB to RocksDB as the default persistent storage mechanism.
    There should be little change for you other than the installation of
    RocksDB. The net benefit will be improved reliability and maintainability
    of the dependency's code base.
   
    If you do not wish to install this dependency or your distro doesn't have
    RocksDB available in a public repo, our build process will use the version
    provided in the third party directory and include the library into the
    static library. This will not install RocksDB, but will increase build
    times when RocksDB needs to be rebuilt. It is advised that you install
    RocksDB from source or your distro's public repos.
   
    To install RocksDB
   
    Ubuntu
   
    sudo apt-get install librocksdb4.1 librocksdb-dev
   
    MacOSX
   
    brew install rocksdb
   
    For CENTOS there does not appear to be a public repo with RocksDB, so
    please follow the instructions the RocksDB install to install it
    permanently and avoid long build times.
   
    https://github.com/facebook/rocksdb/blob/master/INSTALL.md
   
    Finally, if you wish to avoid using system libraries and build our version
    of RocksDB, you can always specify BUILD_ROCKSDB=ON as a variable to CMAKE.
    You can also DISABLE_ROCKSDB , but this will default to using volatile
    repositories.
    Please let me know if you have any questions.
    Marc