From 5cab92096ef297ff83d9d964459810e0c04ebc59 Mon Sep 17 00:00:00 2001 From: Thomas Jarosch Date: Fri, 7 Jun 2013 10:09:22 +0200 Subject: [PATCH] Add note about using JSON for the file index format --- docs/design_ideas.txt | 6 +++++- 1 files changed, 5 insertions(+), 1 deletions(-) diff --git a/docs/design_ideas.txt b/docs/design_ideas.txt index 40bd001..d21009b 100644 --- a/docs/design_ideas.txt +++ b/docs/design_ideas.txt @@ -48,7 +48,11 @@ Intra2net specific requirement: It is just needed to perform the differential backup. - the file index uses an easily parsable, readable and extendable - format. XML might be a good choice. + format, JSON might be a good choice. + + Good read on streaming JSON objects: + http://www.enricozini.org/2011/tips/python-stream-json/ + - The file index can become quite large: make sure it can always be processed as stream and never needs to be completely kept in RAM - Store file positions in the file index to make extraction -- 1.7.1