Bruce,

I should probably not respond and mind the business of the experts given
I'm a newb however can't help myself as I was able to replicate the same
occurrence with my terminal/s.

My tcpdump proved that the data is coming over the wire:

​

I suggest it is more something to do with either special characters
disrupting the signal stream to terminal and I suggest this because I can
output the request to a file and see the complete data represented just how
browsers render it via a normal text editor (gedit/notepad++/etc).

I can even further vi the same file and view the correct data structure
through the terminal like so:

However just as you have suggested if I curl for the data directly or
request for a stream read with more on the output file I see my data gets
chopped between the 2 and the closing select element.

​
I haven't found a solution to why the stream is being chopped however I can
only support your case. =P

Cheers,

Bundy

P.S. will go back to my newb hole now and leave it to the genius's!!!

On 30 November 2015 at 12:21, bruce <badouglas_at_gmail.com> wrote:

> Hi.
>
> Trying to fetch a simple page.
>
> The target is:
> http://www.foothill.edu/schedule/schedule.php
>
> In different browsers, without javascript or referer, results come
> back as expected.
>
> Using different curls settings, can't seem to get the complete
> returned content. The content seems to be missing the select for the
> terms!!
> Almost as though the returned data is corrupted.. But it happens
> consistently, regardless of trying different headers, etc..
>
> I've also tried wget, and get the same results.
>
> my test curl is:
> curl -vvv -k -A "User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0)
> Gecko/20100101 Firefox/38.0" -H 'Accept:
> text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' -H
> 'Accept-Language: en-US,en;q=0.5' -H 'Accept-Encoding: gzip, deflate'
> --cookie-jar aa.lwp --cookie aa.lwp -L
> "http://www.foothill.edu/schedule/schedule.php"
>
>
> any pointers would be cool...
>
> thanks
>
>
>
> this should have a fall/winter term in the select/options..
>
> <strong>Quarter:</strong>
> <span class='indent'>
> <select name="Quarter" id="Quarter">
> <option value="" selected="selected">Select Quarter</option>
> <option value="2</select> &nbsp; <i class='small'>(optional)</i>
> </span><br />
> <div class='indent1'>
> <i class='small'>Current quarter results will be displayed if
> no quarter is selected.
> <br />
> Future quarter listings will appear when the scheduling office
> determines that they are ready for release.</i>
> <br /><br />
> </div>
> -------------------------------------------------------------------
> List admin: http://cool.haxx.se/list/listinfo/curl-users
> FAQ: http://curl.haxx.se/docs/faq.html
> Etiquette: http://curl.haxx.se/mail/etiquette.html
>

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html