11-09-2010, 03:44 AM
Hi,
Is there a way to harvest or extract URL's from a text file ?
For example I have a text file MyFile.txt
Inside it may look like this.
+++++++++++++++++++++++++
Lorem ipsum dolor sit amet, http://www.yahoo.com consectetur adipiscing elit. Duis fermentum www.google.com convallis eros. Pellentesque placerat arcu nec dui mattis eleifend. Vivamus http://www.bing.com/ quis euismod odio. Phasellus http://scrapebox.com/forum dapibus bibendum molestie. Ut mattis facilisis nunc eget commodo. Etiam http://www.TheDomain.com/Directory1/SubD...2/test.php ultrices tincidunt ipsum sit amet vehicula. Aenean consequat tincidunt tempor. Vivamus sapien nisl, volutpat ut commodo in, vehicula nec tellus. Praesent condimentum erat non nulla luctus fringilla. Duis venenatis mattis diam eu gravida.
+++++++++++++++++++++++++++++++++++++++++
I have color coded the domains just for the purpose of display here.
If the URL's can be harvested, please suggest the steps in brief or point me in the right direction.
Is there a way to harvest or extract URL's from a text file ?
For example I have a text file MyFile.txt
Inside it may look like this.
+++++++++++++++++++++++++
Lorem ipsum dolor sit amet, http://www.yahoo.com consectetur adipiscing elit. Duis fermentum www.google.com convallis eros. Pellentesque placerat arcu nec dui mattis eleifend. Vivamus http://www.bing.com/ quis euismod odio. Phasellus http://scrapebox.com/forum dapibus bibendum molestie. Ut mattis facilisis nunc eget commodo. Etiam http://www.TheDomain.com/Directory1/SubD...2/test.php ultrices tincidunt ipsum sit amet vehicula. Aenean consequat tincidunt tempor. Vivamus sapien nisl, volutpat ut commodo in, vehicula nec tellus. Praesent condimentum erat non nulla luctus fringilla. Duis venenatis mattis diam eu gravida.
+++++++++++++++++++++++++++++++++++++++++
I have color coded the domains just for the purpose of display here.
If the URL's can be harvested, please suggest the steps in brief or point me in the right direction.