Method: Wgit::Database::MongoDB#uncrawled_urls

Defined in:
lib/wgit/database/adapters/mongo_db.rb

#uncrawled_urls(limit: 0, skip: 0) {|url| ... } ⇒ Array<Wgit::Url>

Returns Url records that haven't yet been crawled.

Parameters:

  • limit (Integer) (defaults to: 0) —

    The max number of Url's to return. 0 returns all.

  • skip (Integer) (defaults to: 0) —

    Skip n amount of Url's.

Yields:

  • (url) —

    Given each Url object (Wgit::Url) returned from the DB.

Returns:

  • (Array<Wgit::Url>) —

    The uncrawled Urls obtained from the DB.



266
267
268
 
# File 'lib/wgit/database/adapters/mongo_db.rb', line 266

def uncrawled_urls(limit: 0, skip: 0, &block)
  urls(crawled: false, limit:, skip:, &block)
end