.each function returns just one element

• • Reply

  11 months ago

  by makamo66

  Maureen Kathleen Moore

  , United States

  Joined 15 years ago

  The function imgArray returns just one image and not an array. That is, the third column of the spreadsheet which is img lists just one image. Here is my code:

  const rp = require('request-promise');
  const otcsv = require('objects-to-csv');
  const cheerio = require('cheerio');
  
  const baseURL = 'https://www.example.com';
  
  const getCategories = async () => {
  const html = await rp(baseURL);
  
  const imgArray = () => {
  cheerio('td.productListing-data > a > img', html).each((i, image) => {
   img = cheerio(image).attr('src');
  })};
  
  imgArray();
  
    const businessMap = cheerio('.category', html).map(async (i, e) => {
      const link = e.attribs.href;
      const innerHtml = await rp(link);
      const cat = e.children[0].data;
  
      return {
        link,
        cat,
        img,
      }
    }).get();
    return Promise.all(businessMap);
  
  };
  
  getCategories()
  
  
    .then(result => {
      const transformed = new otcsv(result);
      return transformed.toDisk('./spreadsheets/output.csv');
    })
    .then(() => console.log('SUCCESSFULLY COMPLETED THE WEB SCRAPING SAMPLE'));
  

  Report abuse
• • Reply

  11 months ago

  by makamo66

  Maureen Kathleen Moore

  , United States

  Joined 15 years ago

  I changed the code as follows and it still just gives me one item:

  l et img; const images = cheerio('td.productListing-data > a > img', html).map(async (i, image) => { img = cheerio(image).attr('src'); }).get();

  Report abuse
• • Reply

  11 months ago

  by makamo66

  Maureen Kathleen Moore

  , United States

  Joined 15 years ago

  let img;
  const images = cheerio('td.productListing-data > a > img', html).map(async (i, image) => {
  img = cheerio(image).attr('src');
  }).get();
  

  Report abuse
• • Reply

  11 months ago

  by makamo66

  Maureen Kathleen Moore

  , United States

  Joined 15 years ago

  My code was incorrectly formatted and I didn't have the option to edit it so I just re-entered it above.

  Report abuse
• • Reply

  11 months ago

  by makamo66

  Maureen Kathleen Moore

  , United States

  Joined 15 years ago

  I used:

  const images = cheerio('td.productListing-data > a > img', html)
    .map((i, image) => cheerio(image).attr('src'))
    .get()
  

  that had the result that every cell of the spreadsheet contained an array.

  Report abuse
• • Reply

  11 months ago

  by makamo66

  Maureen Kathleen Moore

  , United States

  Joined 15 years ago

  I tried iterating through the array but couldn't make it work with the return statement.

  Report abuse