Dec 10, 2018 08:12:27

Techno in Asia, day 2: Gatsby

by @flowen PATRON | 217 words | 🐣 | 44πŸ’Œ | 3πŸ’§

lowen flowen

Current day streak: 0🐣
Total posts: 44πŸ’Œ
Total words: 16091 (64 pages πŸ“„)
Broken streaks: 3πŸ’§


- fixed Netlify deployment
- hooked up Netlify build with API (this was insanely easy)
- created event-detail-page


- create a test inserting data using strapi API
- create scraper.js with cheerio
- create a scraper user and authenticate in scraper.js
- build in a webhook to netlify after succesful scrape

Let's see if I can get this to work today. That would be awesome and I could focus on the front-end. I'm afraid though I'll probably have some technical difficulties as programming is always at least 200% harder than I think it will be (and this is always reflected in my estimations for clients too).

Did some behind the scenes reading of Gatsby (literally):

I tried to sum up what I read and Jason Lengstorf was nice enough to confirm my little summary:

Gatsby is based on 'nodes', it's basically modelled as json (or actually is json)

Source plugins gather data from different sources to add ’nodes’. During the build process, Gatsby gathers these nodes which can be results from fetched API’s, markdown or a database and I guess the result is a (huge) json data model.

In components we can use the graphql schema to interface with this huge model of data.

-- insert screaming 'YES' gif here -- (new feature request @basilesamel ? πŸ˜‚)

  • 1

    @flowen this looks like something I would love to learn to code (am thinking of making a site that crawls data and displays back in a nice UI). Are you by any chance writing down how you did it?

    Jason Leow avatar Jason Leow | Dec 10, 2018 08:36:52
    • 1

      @jasonleow hey jason, hm writing down everything I do takes me out of my deep work and focus, so I find it hard to write down the whole process. Also it's a full on learning process for me. I'll try and write some more details today

      lowen flowen avatar lowen flowen | Dec 11, 2018 09:27:12
    • 1

      @flowen that's true it does disrupt going deep. No worries then! ;) If you have time to share more at the end of your process, would be grateful! If not, it's ok too no biggie. πŸ‘

      Jason Leow avatar Jason Leow | Dec 11, 2018 09:53:08
  • 1

    @flowen Yes, I mean, what is a life without GIFs? :P

    Basile Samel avatar Basile Samel | Dec 10, 2018 08:17:14
    • 1

      @flowen @basilesamel exactly. Well in the style of this site, let's stay in the word-flow and I'll just keep calling for readers their imagination 8)

      lowen flowen avatar lowen flowen | Dec 10, 2018 08:27:11
contact: email - twitter - facebook