Skip to content

GitLab

Open
Created by Michael Nolan@mikeOwner

Sophia Assignment #2: Zeomine startup and read configuration

--------------- Original ---------------

I will post a couple of currently working configs from Zeomine v2 in here, which we can use in the development of a v3 configuration standard. We need to meet a couple key goals:

  1. It should be straightforward to reference multiple configurations.
  2. It should be straightforward to specify new types of configuration sources (i.e. remote sources).
  3. It should be straightforward to instantiate multiple crawlers.
  4. It should be straightforward to create "short configs" for simple actions.
  5. To do (4), we could have some template configs, and allow the user to start with these, and override just one part (i.e. template: quickcrawl.conf > domain: example.com)

--------------- Edit to add ---------------

Please see below, I have an idea of how we can set up the configuration. We will build to the spec I am proposing.

Edited by Michael Nolan