ScrapeBox Forum
Google Custom Engine - Specific dates - Printable Version

+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Google Custom Engine - Specific dates (/Thread-google-custom-engine-specific-dates)



Google Custom Engine - Specific dates - ZimmmerSEO - 02-16-2015

I would like to know how to make a custom Google search engine that only returns results between specific dates. Say 2000 to 2006.

When testing the below custom engine, it seems to work ok, but does not bring in results from the customized dates. Just recent results.

When using the engine for a search, "custom footprint" "allintitle:test", at the bottom of the tab is says "fetching proxies..." then it hangs.


[UserEngine]
Displayname=Custom Engine
QueryString=http://www.google.com/search?complete=0&output=ie&hl=en&q={KEYWORD}&num=100&start={PAGENUM}&tbs=cdr:1,cd_min:2000,cd_max:2006
MustBeInLink=http:
MustNotBeInLink=webcache.google|q=related:
JustBeforeLink=/url?q=
RightAfterLink=&sa=U&
PageStart=0
PageInc=100
NextPageMarker=<span†style="display:block;margin-left:53px">Next</span>
Translation=%3f=?|%3d==|%26=&|%3a=:|&amp;=&|%2F=/
headerData=
SSLVersion=0
Favicon=
GracePeriod=0
UserAgent=
Selected=1
FollowRelocation=0
AddRelative=
AddFieldValue=
ClearCookies=0
ReadOnly=0

Any ideas?

Thanks


RE: Google Custom Engine - Specific dates - loopline - 02-17-2015

Try this in 2.0. Also your url should be encoded.

http://www.scrapebox.com/v2-beta

QueryString=http://www.google.com/search?complete=0&output=ie&hl=en&q={KEYWORD}&num=100&start={PAGENUM}tbs=cdr%3A1%2Ccd_min%3A1%2F1%2F2000%2Ccd_max%3A1%2F1%2F2006

Just load the page in google in a browser and select your dates and then grab that part of the url that gets generated.


RE: Google Custom Engine - Specific dates - ZimmmerSEO - 02-17-2015

Thanks Loopline. The text string works but doesn't bring back the results from between the dates in question. Just the normal results. I'm using Google.ie and altered the text to suit. Not sure if it makes any difference


RE: Google Custom Engine - Specific dates - loopline - 02-18-2015

Code:
http://www.google.ie/search?q={KEYWORD}&num=100&start={PAGENUM}&tbs=cdr%3A1%2Ccd_min%3A01%2F01%2F2000%2Ccd_max%3A1%2F01%2F2006

This one returns urls from those dates for me.


RE: Google Custom Engine - Specific dates - ZimmmerSEO - 02-18-2015

(02-18-2015, 01:07 AM)loopline Wrote:
Code:
http://www.google.ie/search?q={KEYWORD}&num=100&start={PAGENUM}&tbs=cdr%3A1%2Ccd_min%3A01%2F01%2F2000%2Ccd_max%3A1%2F01%2F2006

This one returns urls from those dates for me.

This is very strange. I'm getting the same results as before. I put in the custom engine, hit the test button and it brings up recent results. The results are localised, (but not only pages from Ireland) that is they are Google.ie results, but not the results I get when I filter the search for dates between 2000-2006.

Is there some setting in scrapebox I've overlooked? I can't understand why you would be getting different results to me.

2000-2006 results for Google.ie "test" is..

Modem Speed Test Page
homepage.tinet.ie/~leslie/testpage.htm
Feb 1, 2001 - These tests measure how long it takes to load a test page from its server, and display it on your browser. Modem configuration, ISP bandwidth, Internet ...

and the normal search without a date filter is...

Speedtest.net by Ookla - The Global Broadband Speed Test
www.speedtest.net/
Test your Internet connection bandwidth to locations around the world with this interactive broadband speed test from Ookla.
‎My Results - ‎Mobile - ‎About - ‎Support

Scrapebox is also giving me the one above. (recent result)

Your advice is appreciated Loopline.


RE: Google Custom Engine - Specific dates - loopline - 02-18-2015

This is what I get when I take the regular google engine that comes with Scrapebox and replace the query string url with the 1 I posted and then harvest with my US based IP address at my office.

http://s22.postimg.org/lu3cuk67l/image.jpg

Try backing up your engines and then going to import (in the screen where you edit the engines) and then download the default engines. Then take the main google engine and replace the query string with mine and then try an actual harvest.

You may still have an old google engine to start with and so modifying it may just modify the old engine and thus it may not work.


RE: Google Custom Engine - Specific dates - ZimmmerSEO - 02-18-2015

(02-18-2015, 07:40 PM)loopline Wrote: This is what I get when I take the regular google engine that comes with Scrapebox and replace the query string url with the 1 I posted and then harvest with my US based IP address at my office.

http://s22.postimg.org/lu3cuk67l/image.jpg

Try backing up your engines and then going to import (in the screen where you edit the engines) and then download the default engines. Then take the main google engine and replace the query string with mine and then try an actual harvest.

You may still have an old google engine to start with and so modifying it may just modify the old engine and thus it may not work.


Hi Loopline,

I tried as you suggested, removed all the engines, uploaded new ones from the server. Replaced the standard google engine with your custom engine....Same results as beforeDodgy

It's quite odd, and doesn't make sense, that it works for you and not me.

CUSTOM SETTINGS: http://postimg.org/image/ripz10g9p/
SEARCH RESULTS: http://postimg.org/image/qrx8v8dwd/


RE: Google Custom Engine - Specific dates - loopline - 02-20-2015

Ok. Lets start over, thanks for the screens. Your using V 1.16.4 and Im using 2.0.0.29 beta, which are worlds apart.

Try this with the 2.0 beta.

http://www.scrapebox.com/v2-beta


RE: Google Custom Engine - Specific dates - ZimmmerSEO - 02-20-2015

(02-20-2015, 03:28 AM)loopline Wrote: Ok. Lets start over, thanks for the screens. Your using V 1.16.4 and Im using 2.0.0.29 beta, which are worlds apart.

Try this with the 2.0 beta.

http://www.scrapebox.com/v2-beta

Yeap,

That did the trick. Many thanks for your patience and perseverance Loopline.

Works perfectly now!


RE: Google Custom Engine - Specific dates - loopline - 02-20-2015

Excellent! Your welcome. Glad you got it sorted. Smile