Skip to content

Document how to work with multiple feeds #10

Description

@ruebot

I have accounts setup, and a couple of have many urls for RSS feeds. Not sure if I have everything setup right. So, we should probably document the best way to setup multiple accounts, and an account that has multiple RSS feeds in it.

Happy to do this work.

I have each account setup in it's own home directory:

  • Toronto Sun /home/nruest/.torontosun
  • Toronto Star /home/nruest/.diffengine
  • Globe & Mail /home/nruest/.globemail
  • Canadaland /home/nruest/.canadaland
  • CBC /home/nruest/.cbc

Toronto Sun has multiple RSS feeds, and I have config.yaml setup like so:

- name: Top Home stories
  twitter:
    access_token: SOMETHING
    access_token_secret: SOMETHING
  url: http://www.torontosun.com/photos/rss.xml
- name: Top Home stories
  twitter:
    access_token: SOMETHING
    access_token_secret: SOMETHING
  url: http://www.torontosun.com/videos/rss.xml
- name: Top Home stories
  twitter:
    access_token: SOMETHING
    access_token_secret: SOMETHING
  url: http://www.torontosun.com/sunshine-girl/rss.xml
...
phantomjs: phantomjs
twitter:
  consumer_key: SOMETHING
  consumer_secret: SOMETHING

Activity

  1. edsu commented on Jan 14, 2017

    @edsu
    Member

    Yes, that is correctly set up! You are right, it's a guessing game for anyone trying to figure it out.

    I'm wondering if it might be good if diffengine evolved some commands?

    % diffengine add-feed
    % diffengine run
    etc ...
    
  2. ruebot commented on Jan 14, 2017

    @ruebot
    MemberAuthor

    Cool. I can add some documentation to the README if you'd like.

    I do like the idea about addition commands!

  3. edsu commented on Jan 14, 2017

    @edsu
    Member

    Also, there is a tradeoff. The nice thing about keeping the configurations and databases separate as you had them is that they can run independently. As you accumulate more and more entries it can take a while to run sometimes, which causes it to fall behind (see #9). Also #4 becomes more important, depending on what your cron schedule looks like.

  4. changed the title [-]Document best practice for multiple feeds for single newspaper, and multiple newspapers[/-] [+]Document how to work with multiple feeds[/+] on Jan 16, 2017
  5. added a commit that references this issue on Mar 11, 2017
  6. ruebot commented on Mar 12, 2017

    @ruebot
    MemberAuthor

    Resolved with: 4ee2e76

  7. added a commit that references this issue on Jun 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions