hi all,
I'm preparing a new release of Torrus software, and it will replace BerkeleyDB back-end with Git.
It appears that libgit2 provides a new, a bit tricky in learning, but very efficient object storage, and change tracking is available out of the box.
In general, you can read and write your data objects directly in the Git repository, without the need of checking in and out the files in your filesystem. Also the objects can be automatically compacted, and that allows storing millions of objects without too much load on the filesystem resources and inode count.
Of course it's not a fully blown database, and not even something like MongoDB, but it really is usable and convenient for document storage systems.
Here are few working examples of using libgit2 (particularly, with its Perl binding, but it's similar in other programming languages): https://github.com/ssinyagin/git_raw_excercise
Also, the new Torrus branch, and changes document: https://github.com/ssinyagin/torrus-newfeatures/tree/v3 https://github.com/ssinyagin/torrus-newfeatures/blob/v3/src/doc/devdoc/v3_ch...
If there's interest in the topic, I will prepare a presentation for the next Swinog meeting.
Hi Stan,
How are you?
Is it still an option to held a short (maybe 15min) speech at SwiNOG #31 on May 30th ?
Thank you for a short reply
Br
Simon
From: swinog-bounces@lists.swinog.ch on behalf of Stanislav Sinyagin ssinyagin@k-open.com Date: Thursday, 5 January 2017 at 00:52 To: swinog@swinog.ch Subject: [swinog] using Git as a database back-end
hi all,
I'm preparing a new release of Torrus software, and it will replace BerkeleyDB back-end with Git.
It appears that libgit2 provides a new, a bit tricky in learning, but very efficient object storage, and change tracking is available out of the box.
In general, you can read and write your data objects directly in the Git repository, without the need of checking in and out the files in your filesystem. Also the objects can be automatically compacted, and that allows storing millions of objects without too much load on the filesystem resources and inode count.
Of course it's not a fully blown database, and not even something like MongoDB, but it really is usable and convenient for document storage systems.
Here are few working examples of using libgit2 (particularly, with its Perl binding, but it's similar in other programming languages): https://github.com/ssinyagin/git_raw_excercise
Also, the new Torrus branch, and changes document: https://github.com/ssinyagin/torrus-newfeatures/tree/v3 https://github.com/ssinyagin/torrus-newfeatures/blob/v3/src/doc/devdoc/v3_ch...
If there's interest in the topic, I will prepare a presentation for the next Swinog meeting.
-
Simon Ryf -
Stanislav Sinyagin