|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.xenbase.scraper.BasicScraper
org.xenbase.scraper.Scraper_PNAS
public class Scraper_PNAS
Constructor Summary | |
---|---|
Scraper_PNAS()
|
Method Summary | |
---|---|
java.lang.String |
getRedirURL(java.lang.String url)
Because we are using URLs from pubmed and because each journal publisher's website is different, we need to go through a series of HTTP 301 redirects, then search the resulting page to find the URL of the full article. |
ScrapedData |
scrape(java.lang.String url)
This is the actual function that takes the URL (produced by getRedirURL) and returns the images and captions of that article. |
Methods inherited from class org.xenbase.scraper.BasicScraper |
---|
getData |
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public Scraper_PNAS()
Method Detail |
---|
public java.lang.String getRedirURL(java.lang.String url) throws java.lang.Exception, java.lang.Error
BasicScraper
getRedirURL
in class BasicScraper
url
- - URL to full article from PubMed
java.lang.Exception
java.lang.Error
public ScrapedData scrape(java.lang.String url) throws java.lang.Exception, java.lang.Error
BasicScraper
scrape
in class BasicScraper
java.lang.Exception
java.lang.Error
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |