Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • D documentation
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • dbnomics-fetchers
  • documentation
  • Wiki
  • solr indexation

Last edited by Christophe Benz Jun 22, 2020
Page history

solr indexation

Infos

  • server: dolos
  • index directory: /var/solr/data/dbnomics/data/index/

Description

  • a full indexation index all the datasets of a provider
  • an incremental indexation indexes only the datasets of a provider that changed in the last commit of its json-data Git repo

Index a provider

  • open https://git.nomics.world/dbnomics/dbnomics-solr/pipelines/new
  • fill the variables PROVIDER_SLUG=scsmich (be careful, it's the slug, and replace by the one you want) and FULL=1 if you need full reindexation (otherwise it will be an incremental indexation)
  • click on "Run pipeline"

Test Solr locally

Cf https://git.nomics.world/dbnomics-fetchers/documentation/wikis/test-fetcher-on-pre-prod#test-solr-queries-locally

Clone repository
  • Git and Gitlab workflow
  • acceptance criteria
    • fetchers
  • ci jobs and runners
  • code optimization
  • dev tools
  • e mails
  • failure handling procedures
  • Home
  • librairies
  • maintaining fetchers
  • monitoring
  • presentation
  • production configuration
  • publishing python packages
  • repositories organization
View All Pages