Software Engineer - Backend Test

The candidate is asked to write a Node.js script to scrape promotion data from various categories on a bank's website. The script should extract the title, image URL, and other details of each promotion into a JSON file organized by category. It should dynamically retrieve category links and page through results, using promises to parallelize the scraping for speed. The candidate is told how to structure and submit their solution.

Uploaded by

Gading Irwanto

Available Formats

Download as DOCX, PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

94 views

Software Engineer - Backend Test

Uploaded by

Gading Irwanto

Available Formats

Download as DOCX, PDF, TXT or read online on Scribd

You are on page 1/ 2

Dear Candidate,

We want you to write a credit card promotion scraper for

https://www.bankmega.com/promolainnya.php

As you can see there are many categories in the website (travel and entertainment, lifestyle and
wellness, F&B, etc).

Please explore each categories using code written in NodeJS. Do not hard code the url of
each category. But it’s ok to hard code this URL https://www.bankmega.com/promolainnya.php
as the starting point

We want you to get all the information about all the promo in each category. So go explore the
links in each categories and get all the promotion in that categories. Don’t forget each category
has pagination link below so please go through each page in the categories. For each
promotion, give me the promotion title, image url, and all other detail that is described in the
promotion. For image promotion, you can grab the image from promotion detail, for example:
https://www.bankmega.com/promo_detail.php?id=874 has an image and other info that you can
grab

Put all the info in a single json file.

The JSON file has a format like this:
{
“travel and entertainment”: [
{
title: "something",
imageurl: "http://something",
Other fields:
},
{
title: "sesuatu 2",
image: "url 2", etc.....
},
],
“lifestyle and wellness”: [
dll
],
Other categories etc....
}

The ordering of the promotions doesn’t matter as long as they are inserted to the correct
category. So you can parallelize the scraping to make it faster. (hint use Promise.all or
Promise.map)
At Cermati, we value individual who likes challenges, is a fast learner, can learn things
independently and have an awesome work ethic.

I will share with you several npm packages that might be useful: (you don't have to use this
though)
1. https://github.com/request/request (to make request)
2. https://github.com/cheeriojs/cheerio (to parse the html and pull data from it)
3. https://www.npmjs.com/package/bluebird (Promise to handle the asynchronous nature of
javascript)

Promise.js has a parallel function. So try to use the "parallel" way of scraping to make scraping
faster.

How to submit the solution (PLEASE READ THIS IS IMPORTANT)

Please submit your solution before due date that mentioned in email.
Please zip your entire solution directory and attach it into this email. Don’t include the result json
into this solution.
● Your code should be named ‘solution.js’ and we will run it like this: `node solution.js`
● make sure you also include your package.json and node_modules directory in the zip
file.
● When running your ‘solution.js’, we expect the scraped_data will be put into a file called
‘solution.json’.
● Please make sure the solution runs on node version 8. This is what we are going to use
to determine the correctness of your solution.

Thanks, let us know if you have questions. And if you want to know more about our engineering
team, please visit engineering.cermati.com