WebGrab+Plus

  • You're on your own, now

    Upon a reboot of my rpi2 to install milhouse nightly build of LibreELEC service.webgrabplus was restarted and back into every six hour EPG update + my cron job 03:00. (Assume because it Stops but does not fully Disable service, when disabling the WebGrab+Plus service addon?)

    So for now in summary :-

    1. Disabled WebGrab+Plus service via the Kodi Ui (Fully disables addon, but currently believe does not fully disable service?)
    2. Disabled service via the command line (systemctl stop service.webgrabplus, then systemctl disable service.webgrabplus)
    3. Utilising a cron job to run webgrabplus.start automatically and only once a day at 03:00

    Edited once, last by MikeKL (August 19, 2016 at 3:56 PM).

  • Upon a reboot of my rpi2 to install milhouse nightly build of LibreELEC service.webgrabplus was restarted and back into every six hour EPG update + my cron job 03:00. (Assume because it Stops but does not fully Disable service, when disabling the WebGrab+Plus service addon?)

    So for now in summary :-

    1. Disabled WebGrab+Plus service via the Kodi Ui (Fully disables addon, but currently believe does not fully disable service?)
    2. Disabled service via the command line (systemctl stop service.webgrabplus, then systemctl disable service.webgrabplus)
    3. Utilising a cron job to run webgrabplus.start automatically and only once a day at 03:00

    systemctl disable, not systemctl stop ;)

  • Hi guys,

    you were here talking about exporting epg somewhere on NAS via samba or etc. I tried everything i can and the only way which worked for me was mounting a directory. (i am no linux expert, just followed step by step) any way i used this

    mount -t cifs -o username=xxx,password=xxx //192.168.0.140/admin/kodi/EPG .kodi/userdata/addon_data/service.webgrabplus/EPG

    the problem is that after every restart i have to log in to rpi and execute this command manualy

    is there a way how to use this command after every restart automaticly?

    (sorry for my english, its not my native language)

  • Hello milan,

    I am not sure to understand what you are trying to do. Are you trying to copy guide.xml to your NAS?

    Are you aware that the guide is already available at you LibreELEC device via SMB (smb://libreelec.local/userdata/addon_data/service.webgrabplus/guide.xml)?

    If you really need to copy the guide to your NAS, you can do that through the custom processing: for pre-processing, create before.sh shell script in the addon home folder (smb://libreelec.local/userdata/addon_data/service.webgrabplus/before.sh); for post-processing, create after.sh shell script in the addon home folder (smb://libreelec.local/userdata/addon_data/service.webgrabplus/after.sh).

    Simply put your mount and copy commands in the shell scripts as appropriate

    I hope this has helped you


  • I have managed to build Mono for Odroid_C2.

    Volunteers may thus test WebGrab+Plus on Odroid_C2

    To test:

    Hello awiouy,

    Thanks for the addons i installed them on my C2 and it works great!

    If i run webgrab i get a guide_wpg.xml instead of a guide.xml is this correct?
    I'm running tvheadend from a seperate odroid XU3 and i trying to manage the guide.xml into my seperate tvheadend server but i can't get it to work.

    I tried to mount the folder in tvheadend server where the guide.xml exist over smb but still no luck.

    I have a tv_grab_wg++ file in /usr/bin in tvheadend server like this

    #!/bin/bash
    xmltv_file_location=smb://192.168.178.169/storage/userdata/addon_data/service.webgrabplus
    dflag=
    vflag=
    cflag=
    qflag=
    if (( $# < 1 ))
    then
    cat "$xmltv_file_location"
    exit 0
    fi

    for arg
    do
    delim=""
    case "$arg" in
    #translate --gnu-long-options to -g (short options)
    --description) args="${args}-d ";;
    --version) args="${args}-v ";;
    --capabilities) args="${args}-c ";;
    --quiet) args="${args}-q ";;

    #pass through anything else
    *) [[ "${arg:0:1}" == "-" ]] || delim="\""
    args="${args}${delim}${arg}${delim} ";;
    esac
    done

    #Reset the positional parameters to the short options
    eval set -- $args

    while getopts "dvcq" option
    do
    case $option in
    d) dflag=1;;
    v) vflag=1;;
    c) cflag=1;;
    q) qflag=1;;
    \?) printf "unknown option: -%s\n" $OPTARG
    printf "Usage: %s: [--description] [--version] [--capabilities] \n" $(basename $0)
    exit 2
    ;;
    esac >&2
    done

    if [ "$dflag" ]
    then
    printf "$0 is a wrapper grabber around WebGrab+Plus\n"
    fi
    if [ "$vflag" ]
    then
    printf "0.2\n"
    fi
    if [ "$cflag" ]
    then
    printf "baseline\n"
    fi
    if [ "$qflag" ]
    then
    printf ""
    fi

    exit 0

    maybe you can tell em what i'm doing wrong?

    Thanks!

  • Hello Marciano!

    Thank you for the positive feedback. You just confirmed that a recent version of Mono builds and runs static for all LibreELEC projects. I am happy about this, and I hope it will stay that way.

    WebGrab+Plus indeed creates guide_wgp.xml, but it is then copied into guide.xml and mediaportal.xml by xmltv_time_correct and WP2MP. Refer to guide.xml and mediaportal.xml rather than guide_wpg.xml, whose state is transient while WebGrab+Plus is running, which may last quite a long time.

    A preferred option is for consumers to access http://guide.xml/mediaportal.xml at the LibreELEC/webgraplus producer, eg at smb://libreelec.local/userdata/addon_data/service.webgrabplus/guide.xml.

    If that is not possible, create after.sh shell script in smb://libreelec.local/userdata/addon_data/service.webgrabplus/after.sh, eg to mount a destination and copy http://guide.xml/mediaportal.xml to that destination.

    I hope this has helped you

    EDIT:
    To mount a smb share on linux, adapt the command below to your needs:

    Code
    mount -t cifs -o username=USERNAME,password=PASSWD //192.168.1.88/shares /mnt/share

  • Thank you awiouy,

    I created a after.sh shell script with my copy command and if i run that script manually from the webgraplus folder script is working fine.
    But how to run this script automaticly?
    Is the after.sh shell script starting auto when webgrab finished with grabbing channels and mdb postprocessing?

    Edited once, last by Marciano (August 27, 2016 at 11:59 PM).

  • Hi awiouy,

    Grabbing tv channels works great but slow but something is wrong with mdb postprocessing.

    I tried it several times but it fails with this error from log:

    [Critical] Unhandled Exception
    [Critical]
    Object reference not set to an instance of an object
    [Critical]
    at WGconsole.PostProcess+MdbScrub.GetMusthaveCompare (WGconsole.MdbIni mi, System.Xml.XmlNode show, System.String type) <0x7f9ea58000 + 0x008c0> in <filename unknown>:0
    at WGconsole.PostProcess.PostProcess_MDB () <0x7f9ec38000 + 0x021b3> in <filename unknown>:0
    at WGconsole.PostProcess..ctor (System.String[] processes) <0x7f9f318350 + 0x004b7> in <filename unknown>:0
    at WGconsole.Program.ConsoleApplication (System.String[] args) <0x7fa4f73000 + 0x05c77> in <filename unknown>:0
    at WGconsole.Program.Main (System.String[] args) <0x7fa4f68338 + 0x00057> in <filename unknown>:0
    [Critical] For detailed info, see log file WebGrab++.log.txt
    [Critical] Execution stopped

    Maybe you can help me with this?

  • Is there detailed info in WebGrab++.log.txt?
    That file should be in the addon's home folder


  • Hi awiouy,

    I paste the content of my WebGrab++.log.txt here.

    Hope this is useful.

    Thanks!

    Hello Marciano!

    The logs you provide suggest that your problem is related to mdb post-processing
    According to the WebGrab+Plus web site, mdb.ini files have changed with version pre56.25.
    It is however unclear where updated mdb.ini can be found or where they should be placed.

    Unfortunately, WebGrab+Plus does not ship as a coherent set of files, but piecemeal.
    I have tried to overcome this problem by grouping a coherent set of files in a github repository.
    Apparently, I have overlooked updated mdb.ini files.
    I am sorry for this.

    If anyone here knows where I can find the updated mdb.ini files and where WebGrab+Plus expects them, please report here and
    I will update the addon accordingly.

    Until then, I am afraid mdb post-processing is broken.

  • Thnx for looking awiouy!
    I hope this can be fixed soon!

  • Argh!

    The mdb.ini files are shipped with siteini.pack.
    mdb post-processing however expects them in the mdb folder.

    Then, WebGrab+Plus creates one or two guides, depending on whether grab/run are enabled.
    The guides further have distinct names.

    What a mess!

    I will nevertheless try to adapt the addon.


  • Argh!

    The mdb.ini files are shipped with siteini.pack.
    mdb post-processing however expects them in the mdb folder.

    Then, WebGrab+Plus creates one or two guides, depending on whether grab/run are enabled.
    The guides further have distinct names.

    What a mess!

    I will nevertheless try to adapt the addon.

    Yes! i found the files in the siteini.pack from the webgrab++ site!
    Then copied the files and overwrite the existing files and change the language for my purpose and ran the mdb-postprocessing again and it seems to working right now

    When finished i let you know!

    Thanks and cheers!

    Edited once, last by Marciano (August 28, 2016 at 9:59 PM).

  • This pull request updates the mdb ini files.
    mdb post-processing should now be operational.


    I am looking for volunteers to test the preview releases below:


    Please report here if it makes or if it breaks
    [hr]

    Yes! i found the files in the siteini.pack from the webgrab++ site!
    Then copied the files and overwrite the existing files and change the language for my purpose and ran the mdb-postprocessing again and it seems to working right now

    When finished i let you know!

    Thanks and cheers!

    Where do you change the language?


  • This pull request updates the mdb ini files.
    mdb post-processing should now be operational.

    I am looking for volunteers to test the preview releases below:


    Please report here if it makes or if it breaks
    [hr]

    Where do you change the language?

    In the mdb folder you have to edit the tvdb.com.bin.ini

    To set the prefered language, do the following:

    1. Open for editing tvdb.com.bing.ini .
    2. Have a look at the table below, it gives the language codes of the available languages in thetvdb.
    Remember the tow letter code for your language. e.g sv for Swedisch
    The language number is not relevant here.
    3. Locate this line:
    mdb_temp_4.modify {addend|'mdb_temp_1'/all/en####} * change this line to set your prefered language!!
    And change en#### into sv#### for Swedisch
    4. Save tvdb.com.bing.ini , obtionally with another name , like tvdb.com.bing_sv.ini to distinguis it from the original.
    In that case also change the filename in mdb.config

    That's all!!

    thetvdb available languages and their codes:

    English 7 en
    Svenska 8 sv
    Norsk 9 no
    Dansk 10 da
    Suomeksi 11 fi
    Nederlands 13 nl
    Deutsch 14 de
    Italiano 15 it
    Español 16 es
    Français 17 fr
    Polski 18 pl
    Magyar 19 hu
    Greek 20 el
    Turkish 21 tr
    Russian 22 ru
    Hebrew 24 he
    Japanese 25 ja
    Portuguese 26 pt
    Chinese 27 zh
    Czech 28 cs
    Slovenian 30 sl
    Croatian 31 hr
    Korean 32 ko

    Are the new preview releases also for odroid C2?

    Edited once, last by Marciano (August 28, 2016 at 10:45 PM).