[messaging] Zero-metadata object store
Mikalai Birukou
mb at 3nsoft.com
Mon Dec 2 07:08:19 PST 2019
Peter,
>> Do metadata objects contain file tree information?
>>
>> Is file tree continuously packed into mobjects, i.e. many folders' data is placed into every mobject? Or, is it a one mobject per folder structure?
>>
> File system information and keying information are in mobjects, and they are continuously packed. The aim is to sync the repo index independently from any other content using as little bandwidth as possible.
Question about dobjects, objects with data chunks. Does dobject carry
chunks from one file, or, can it have chunks from different files?
I am trying to picture it. If mobjects and dobjects carry data from
different files, then will it be correct to think about zerostash like
they are disk segments? Disk segments are always same size, and they may
keep data from different files. Is disk analogy correct?
Longer question with context:
We have the following scenario for sync-ed fs. User has two devices, and
some program runs on both of them. This program may be changing same
files. Server is used to setup transaction walls on objects using object
ids.
{ So far we use model with file stored in 1 or more objects, and not
many files in same object.
https://github.com/3nsoft/xsp-files#xsp-file-format provides packing
bytes without knowledge of a file system. File system is formulated
inside of a client project, with the following interface
https://github.com/3nsoft/core-platform-electron/blob/master/src/api-defs/web3n.d.ts#L151
. Each object changes in a transaction allowing for a strict version
changes. Server api has transaction-related replies like in
https://github.com/3nsoft/spec-server/blob/master/src/lib-common/service-api/3nstorage/owner.ts#L205
}
Is it possible to have a similar transaction identification and change
signalling using info available on the server (e.g. object ids), so that
client with knowledge of mapping between this info and files can
identify file system events, and be aware of current writes to server?
More information about the Messaging
mailing list