From: Thomas Jarosch Date: Fri, 7 Jun 2013 08:09:22 +0000 (+0200) Subject: Add note about using JSON for the file index format X-Git-Tag: v2.2~196 X-Git-Url: http://developer.intra2net.com/git/?a=commitdiff_plain;h=5cab92096ef297ff83d9d964459810e0c04ebc59;p=python-delta-tar Add note about using JSON for the file index format --- diff --git a/docs/design_ideas.txt b/docs/design_ideas.txt index 40bd001..d21009b 100644 --- a/docs/design_ideas.txt +++ b/docs/design_ideas.txt @@ -48,7 +48,11 @@ Intra2net specific requirement: It is just needed to perform the differential backup. - the file index uses an easily parsable, readable and extendable - format. XML might be a good choice. + format, JSON might be a good choice. + + Good read on streaming JSON objects: + http://www.enricozini.org/2011/tips/python-stream-json/ + - The file index can become quite large: make sure it can always be processed as stream and never needs to be completely kept in RAM - Store file positions in the file index to make extraction