wget issue

Thu Apr 2 17:07:16 UTC 2015

2015-04-02 19:29 GMT+03:00 bruce <badouglas at gmail.com>:

> Hey guys. I know this isn't a fed/linux issue, but thought I might get
> some pointers. This has also been posted to the wget list as well.
>
> Trying to fetch class content from a site.
>
> Tested the site, using firefox/firebug appears the site does a couple of
> calls.
>
> Created a quick shell script to implement the test calls, but for some
> reason, cant seem to generate the actual class list.
>
> Steps:
> -fire off the initial page
> -select the 1st dept "accounting" - use/leave the rest of the defaults
> -implement the "select" btn, to generate the backend calls.
> -in the testing of the 2nd step, the test uses the actual post-data as
> generated via the firefox/firebug test
>
> The results of the 2nd call - returns the same data as the initial
> call to the base page. I assume Im missing something simple, or else
> the app is doing some jscript on the backend that I'm not seeing.
>
> using -vvv for verbosity doesn't point to anything as far as I can tell.
>
> Thoughts/pointers are welcome.
>
> thanks
>
> #!/bin/sh -v
> #
> # test shell for wget
> #
> # smc_curl.sh
>
>
>
> #smc
> wget -vvv --no-check-certificate  --cookies=on --load-cookies=smc.lwp
> --keep-session-cookies --save-cookies=smc.lwp
> --user-agent="Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.11)
> Gecko/2009061118 Fedora/3.0.11-1.fc9 Firefox/3.0.11"  -O -
> "https://isiscc.smc.edu/pls/apex/f?p=123:1:4004293957286646::NO:RP::"
> #exit
>
> wget  -vvv  --no-check-certificate  --cookies=on
> --load-cookies=smc.lwp --keep-session-cookies --save-cookies=smc.lwp
> --referer="
> https://isiscc.smc.edu/pls/apex/f?p=123:1:4004293957286646::NO:RP::"
> --user-agent="Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.11)
> Gecko/2009061118 Fedora/3.0.11-1.fc9 Firefox/3.0.11"   -O -
>
> --post-data="p_flow_id=123&p_flow_step_id=1&p_instance=9199705513605&p_page_submission_id=10860495851326&p_request=SUBMIT&p_arg_names=6371933991931405031&p_t01=Spring+2015&p_arg_names=6362920808091113318&p_t02=1+%2C+2+%2C+3+%2C+4+%2C+5+%2C+6+%2C+7+%2C+12&p_arg_names=6362811294857854001&p_t03=%27OPEN%27+%2C+%27CLOSED%27&p_arg_names=6374897696943587288&p_t04=20151&p_arg_names=3851224476948135099&p_t05=1&p_arg_names=3851225084220137224&p_t06=2&p_arg_names=6361666501512343398&p_v07=5&p_arg_names=6362829299321902607&p_arg_names=6363404907668258054&p_arg_names=6363528795332614067&p_arg_names=6363575091232717019&p_arg_names=6363649096707888902&p_arg_names=3851458085236906098&p_t13=April+++++02%2C+2015+%40+05%3A05+am&p_arg_names=6372068906550664708&p_t14=cls_web_list_20151&p_arg_names=6372277789412047762&p_t15=web_cat_sched_20151&p_arg_names=6361721707633487104&p_t16=where+cat_grp_seq_num+in+%28cat_grp_seq_num%29+and+cls_status+in+%28%27OPEN%27+%2C+%27CLOSED%27%29+and+print_seq+in+%28print_seq%29+and+print_seq+in+%281+%2C+2+%2C+3+%2C+4+%2C+5+%2C+6+%2C+7+%2C+12%29+and+nvl%28gnr_emply_name%2C%27*%27%29+in+%28nvl%28gnr_emply_name%2C%27*%27%29%29+and+nvl%28ssn_days%2C%27*%27%29+in+%28nvl%28ssn_days%2C%27*%27%29%29+and+sct_begin_week+in+%28sct_begin_week%29+and+nvl%28begin_time%2C%270%27%29+in+%28nvl%28begin_time%2C%270%27%29%29&X01=current&p_md5_checksum=&p_page_checksum=D0B7E209D8B98CC0A86474C8266D5F59"
>   "https://isiscc.smc.edu/pls/apex/wwv_flow.accept"
> exit
> --
>

Curl is better anyway. However with wget, issue is incorrect cookie (path?)
reading from savefile.
Read ORA_WWV_APP_123 value from cookie savefile, and send it in raw
"--header" format

wget --no-cookies --header "Cookie:
ORA_WWV_APP_123=ORA_WWV-nFa8PnpRSIhvaZ1y372N5oNh" --user-agent="Mozilla/5.0
(X11; U; Linux x86_64; en-US; rv:1.9.0.11) Gecko/2009061118
Fedora/3.0.11-1.fc9 Firefox/3.0.11" -O -
--post-data="p_flow_id=123&p_flow_step_id=1&p_instance=13303426118424&p_page_submission_id=6667078945709&p_request=SUBMIT&p_arg_names=6371933991931405031&p_t01=Spring+2015&p_arg_names=6362920808091113318&p_t02=1+,+2+,+3+,+4+,+5+,+6+,+7+,+12&p_arg_names=6362811294857854001&p_t03='OPEN'+,+'CLOSED'&p_arg_names=6374897696943587288&p_t04=20151&p_arg_names=3851224476948135099&p_t05=1&p_arg_names=3851225084220137224&p_t06=2&p_arg_names=6361666501512343398&p_v07=5&p_arg_names=6362829299321902607&p_arg_names=6363404907668258054&p_arg_names=6363528795332614067&p_arg_names=6363575091232717019&p_arg_names=6363649096707888902&p_arg_names=3851458085236906098&p_t13=April+++++02,+2015+ at +08:05+am&p_arg_names=6372068906550664708&p_t14=cls_web_list_20151&p_arg_names=6372277789412047762&p_t15=web_cat_sched_20151&p_arg_names=6361721707633487104&p_t16=where+cat_grp_seq_num+in+(cat_grp_seq_num)+and+cls_status+in+('OPEN'+,+'CLOSED')+and+print_seq+in+(print_seq)+and+print_seq+in+(1+,+2+,+3+,+4+,+5+,+6+,+7+,+12)+and+nvl(gnr_emply_name,'*')+in+(nvl(gnr_emply_name,'*'))+and+nvl(ssn_days,'*')+in+(nvl(ssn_days,'*'))+and+sct_begin_week+in+(sct_begin_week)+and+nvl(begin_time,'0')+in+(nvl(begin_time,'0'))&X01=current&p_md5_checksum=&p_page_checksum=CABDFE47E3CB96CAA517653D5D1E1B8F"
https://isiscc.smc.edu/pls/apex/wwv_flow.accept

> users mailing list
> users at lists.fedoraproject.org
> To unsubscribe or change subscription options:
> https://admin.fedoraproject.org/mailman/listinfo/users
> Fedora Code of Conduct: http://fedoraproject.org/code-of-conduct
> Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
> Have a question? Ask away: http://ask.fedoraproject.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.fedoraproject.org/pipermail/users/attachments/20150402/ddf21df4/attachment.html>