.NET
- C#
- VB.NET
- F#
- Azure
- ASP.NET
  - ASP.NET AJAX
  - ASP.NET MVC
- LINQ
- ADO.NET
Java
Open Source
Mobile
Database
Architecture
RIA & Web
Toolbox

Retrive html content using System.Net.HttpWebRequest

Last post was 22 Apr 2007 at 11:13

asp.net Romania

- Reply
13 years ago

by Costin Trifan

Costin Trifan

Ploiesti, Romania

Joined 13 years ago
Hello!

I want to retrive some html content from a given website. For that I use the System.Net.HttpWebRequest:

Dim connectionString As String = "some url here"
Try

Dim myRequest As System.Net.HttpWebRequest = WebRequest.Create(connectionString)
            myRequest.Credentials = CredentialCache.DefaultCredentials

'// Get the response

   Dim webResponse As WebResponse = myRequest.GetResponse
   Dim respStream As Stream = webResponse.GetResponseStream

'//

   Dim ioStream As StreamReader = New StreamReader(respStream)
   Dim pageContent As String = ioStream.ReadToEnd

    Response.Write(pageContent)
'// Close streams

ioStream.Close()
    respStream.Close()

Catch ex As Exception
        Me.Label1.Text = ex.Message

End Try

The above code works, but the problem is that it retrieves all the html content...and I don't nee it all.

All I need is all the content between <head> and </head>

[ originally posted on forums.asp.net ]

Report abuse
- Reply
13 years ago

by pcmattman

pcmattman

, Australia

Joined 15 years ago
Just parse the html and take what's between the head tags.

The nature of the request is that you can't specify that you want just the head tags, because the server always sends the full data when it gets a request.

Report abuse
- Reply
13 years ago

by Costin Trifan

Costin Trifan

Ploiesti, Romania

Joined 13 years ago
Hi pcmattman, and thank you for the reply!

I thought about what you've said myself, but there is a problem...I don't know how to do it ...

I've searched the net and I couldn't find an example on how to do it...They were only showing the way of retrieving all the content and not parts of it.

I'm a seo consultant and a web designer. I always liked VB but my knowledge is limited though...
(I use programming only when I have to)

Maybe you can help me providing a sample code, please?

[ I should start learn more...]

Report abuse