Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
foundation:gsoc_tahir [2010/06/08 01:13]
amertahir
foundation:gsoc_tahir [2010/07/07 19:47] (current)
amertahir
Line 5: Line 5:
 ===== Executive Summary ===== ===== Executive Summary =====
   *Abstract: Automatic sync between Sahana instances has received much attention from Sahana community. It aims to sync resources between multiple Sahana instances. I will work on resolving its current issues and adding new features:   *Abstract: Automatic sync between Sahana instances has received much attention from Sahana community. It aims to sync resources between multiple Sahana instances. I will work on resolving its current issues and adding new features:
-    - Make sync peer discovery work over WANs & LANs by combining ZeroConf with Beacon Service (an online directory of Sahana instances) 
     - Modifying sync process to work with S3XRC resources instead of DB tables to maintain full references     - Modifying sync process to work with S3XRC resources instead of DB tables to maintain full references
     - Offline Sync facility (USB)     - Offline Sync facility (USB)
 +    - Add the facility to schedule multiple custom sync jobs (custom - weekly/daily/one-time with selected or all resources)
 +    - Make sync peer discovery work over WANs & LANs by combining ZeroConf with Beacon Service (an online directory of Sahana instances)
   * Student: Amer Tahir    * Student: Amer Tahir 
   * Mentor(s): Fran Boon and Michael Howden   * Mentor(s): Fran Boon and Michael Howden
Line 15: Line 16:
   * [[http://docs.google.com/Doc?docid=0Aamq1EGpWCAhZGRxNzJnMzdfMzRoYm1ieGJkbQ&hl=en|Functional Specs]]   * [[http://docs.google.com/Doc?docid=0Aamq1EGpWCAhZGRxNzJnMzdfMzRoYm1ieGJkbQ&hl=en|Functional Specs]]
   * [[https://code.launchpad.net/~amertahir/sahana-eden/sync|Launchpad Branch]]   * [[https://code.launchpad.net/~amertahir/sahana-eden/sync|Launchpad Branch]]
-  * [[http://sync.sahanafoundation.org/|Demo instance]]+  * [[http://sync.eden.sahanafoundation.org/eden/|Demo instance 1]] 
 +  * [[http://view.lums.edu.pk:8001/eden/|Demo instance 2]] 
 + 
 +===== How To Use ===== 
 +== Downloading and Installation == 
 +Do "bzr checkout lp:~amertahir/sahana-eden/sync" (without quotes) to get the latest source-code from repository. Then rename the sync directory to eden and place it under your web2py applications directory. That's all, now fire up your browser and open http://127.0.0.1:8000/eden/ to get started :) 
 + 
 +NOTE: the demo instances (specified above) could also be used to test out sync (use username: admin@example.com and password: admin to login) 
 + 
 +== Getting Started == 
 +After setting up the instance, you have to first Register (or Login with administrative account) and specify a few settings for sync. For this, open Administration page and then click Sync > Sync Settings from the menu. You will see the settings page for sync. Here you have to specify you instance URL (e.g. http://sync.eden.sahanafoundation.org/eden), description and so on. 
 + 
 +Then proceed to the Synchronisation main page. From there you can sync manually (click "Sync Now"), add sync partners, subscribe to sync pools, resolve sync conflicts and so on. The page is self-explanatory. 
 + 
 +== How to Sync? == 
 +Synchronisation process works automatically in the background (as Cron jobs) and you can use the Sync Scheduler to manage sync jobs. However, if you wish to bypass that and manually perform sync, you can click "Sync Now" button to start syncing with sync partners that you have specified. 
 + 
 +== Sync Partners == 
 +Sync Partners are instances that you wish to sync with. They could be deployed on SahanaEden, SahanaAgasti, Ushahidi or possibly any platform that SahanaEden can talk to (currently Eden, Agasti and Ushahidi are supported). 
 + 
 +Before you can start syncing, you need to define sync partners. This can be done by going to the Sync Partners page. You can either search for partners or add them manually (right now only manual additions are supported). Every sync partner has a UUID (0 for non-Eden instances), instance URL (e.g. http://sync.eden.sahanafoundation.org/eden), instance type (Eden/Agasti/Ushahidi/etc.) and Sync Policy. Sync policies other than "No Sync" only come into play when the data that is imported also exists locally. It could be the case that local data is modified after the last sync with this peer (Local is newer), similar for remote data (Remote is newer) or both have been modified (either of them is newer). So, to decide how to resolve such 'conflicts' automatically, you can select one of the sync policies. If you want to manually resolve such conflicts, select "Choose Manually"
 + 
 +== Sync Schedules == 
 +To automate the sync process, you can define sync jobs. Sync Jobs are individual syncing processes with sync partners that you like. So, if I want to sync "Person Registry" with some sync partner, I would just create a new sync job and select "Person Registry" and the sync partner I want to sync with. Along with that, I would specify the scheduled time for the job to run, either daily, weekly, hourly or just once. 
 + 
 +You can define multiple sync jobs for a particular sync partner, specifying resources to sync and sync policies individually for each of the sync jobs. By default, only resources modified after the last sync operation (new data) are synced. This is similar to differential backups. However, if you want to sync all data, you can specify "Complete Sync" in the job settings. 
 + 
 +\\ 
 +** This section is a work in progress and would be updated as development is carried out on this project **
  
 ===== Progress ===== ===== Progress =====
 == Weekly Meetings == == Weekly Meetings ==
-  * Thursdays at 1400 UTC [[http://www.google.com/calendar/embed?src=kofgu229eig2bpfqth0bfc57qc%40group.calendar.google.com&ctz=America/New_York|Calendar]] at IRC+  * Thursdays at 1400 UTC [[http://www.google.com/calendar/embed?src=kofgu229eig2bpfqth0bfc57qc%40group.calendar.google.com&ctz=America/New_York|Calendar]] at IRC (this is tentative schedule, *would* change)
  
 == Progress Reports == == Progress Reports ==
Line 25: Line 54:
  
 == Project Plan and Timeline == == Project Plan and Timeline ==
 +Following are the chosen [[http://en.wikipedia.org/wiki/SMART_criteria|SMART]] Goals that were recommended during the application process, and reviewed over the bonding period:
 +
 +^Midterm Evaluation Milestones: 24 May - 12 July^^^^
 +^Goal^Measure^Due Date^Status^
 +|Modify the existing sync process to work with S3XRC import/export instead of working directly with DB tables (and records)|Prototype demo of the S3XRC powered sync system|06/09/2010|Completed|
 +|Incorporate automatic conflict resolution policies in the sync system|Demo of a working (possibly buggy) implementation|06/20/2010|Completed|
 +|Finalizing conflict resolution policies after bug fixing and preparation of test scenarios to verify it|Demo of the sync system with conflict resolution including Test Plan and Test Report that would be approved after review by the mentor(s)|06/29/2010|Incomplete|
 +|Finalize the sync system with bug fixing and changes suggested by the mentor(s) along with testing of the entire system|Demo of the sync system with testing procedures defined (Test Plan); approval by the mentor(s)|07/11/2010|Incomplete|
 +
 +\\
  
 +^Final Evaluation Milestones: 13 July - 9 August^^^^
 +^Goal^Measure^Due Date^Status^
 +|Implement the Offline Sync (USB flash sync) functionality in the sync system|Prototype demo of the offline sync (possibly buggy)|07/18/2010|Incomplete|
 +|Incorporating Beacon service into the sync implementation to work along with ZeroConf daemon|Demo of a working (possibly buggy) implementation of sync that utilizes both Beacon service and ZeroConf along with approval by the mentor(s)|07/20/2010|Incomplete|
 +|Implementation of multiple sync pools with automatic discovery of sync partners using Beacon service and ZeroConf|Demo of the working system along with approval from the mentor(s)|08/01/2010|Incomplete|
 +|Bug fixing of the offline sync and other components of the sync system|Progress report submitted to the mentor(s), then reviewed and approved by them|08/05/2010|Incomplete|
 +|Final integration of the entire system, preparing it for the demo|Demo of the entire sync system, approval by the mentor(s)|08/09/2010|Incomplete|

Navigation
QR Code
QR Code foundation:gsoc_tahir (generated for current page)