WebGrab+Plus

  • Hello everyone.
    I have seen, that Webgrab is not supported for Odrioid C2 devices.Is that mean that also is not supported for Wetek Hub, which has an Amlogic 905?
    Thanks in advance.

    Sent from my OnePlus 2 using Tapatalk

  • I'm faceing some trouble to install it.I'm not able to find it in official LibreELEC Add-ons.My setup is Wetek Hub with installed LibreELEC (WRXTASY) 7.0.2
    Can someone help me to resolve this problem?

    Edited once, last by b_ignatov (November 28, 2016 at 3:08 PM).

  • Hi.
    How to get tvheadend (on the same device - pi3), to see the internal grabber?

    i've used the tvheadend configure to point it to the .xml file (through smb on the same device), but in tvheadend i cannot see the "internal grabber" in the webif, and selecting external does nothing either.

    is there something i'm missing?

    thanks

  • Hi
    tv_grab_file is visible in TVHeandend Webinterface when could locate xmltv file
    so in tvheadedn42 addon settings you must specific directory where is located your XMLTV
    and choose type - "file"

    Edited once, last by piotrasd (December 14, 2016 at 10:59 AM).


  • Hi
    tv_grab_file is visible in TVHeandend Webinterface when could locate xmltv file
    so in tvheadedn42 addon settings you must specific directory where is located your XMLTV
    and choose type - "file"

    thanks.

    i've done this, and in my tvheadend settings.xml in libreelec i have

    Code
    <setting id="XMLTV_LOCATION_FILE" value="smb://127.0.0.1/userdata/addon_data/service.webgrabplus/channels.xml" />

    in my webgrab++.config.xml i output to channels.xml and the file is there (3MB in size).

    pointing tvheadend to channels.xml doesn't enable the grabber :( (tvh 4.2)

  • thanks.

    i've done this, and in my tvheadend settings.xml in libreelec i have

    Code
    <setting id="XMLTV_LOCATION_FILE" value="smb://127.0.0.1/userdata/addon_data/service.webgrabplus/channels.xml" />

    in my webgrab++.config.xml i output to channels.xml and the file is there (3MB in size).

    pointing tvheadend to channels.xml doesn't enable the grabber :( (tvh 4.2)

    tried with Userdata (capital U)

    has anyone else got this working... driving me nuts :(

    i've tried fresh installs without changing the xml filename in the config.. same issue

    is this broken?

    Edited once, last by snailboy1 (December 15, 2016 at 11:56 PM).

  • Hi, i am new to LibreElec and I am trying to get the EPG working propular. I tried all the others that came with LibreElec to no avail so am no trying to get Webgrab working.

    I am getting a:

    [ Info ] ( 1/539 ) TVGUIDE.CO.UK -- chan. (xmltv_id=&TV) -- mode Incremental
    [Warning ] error downloading page: The request timed out (5sec)
    [Warning ] Retry 1 of 4 times

    And it keeps doing that. As I said I am a newbie, so would also appreciate a step by step guide if anyone has one.

    Log file:
    [ ]
    [ ] WebGrab+Plus/w MDB & REX Postprocess -- version V1.57
    [ ]
    [ ] Jan van Straaten
    [ ] Francis De Paemeleere
    [ ]
    [ ] thanks to Paul Weterings and all the contributing users
    [ ] --------------------------------------------------------------------------------
    [ ]
    [ ] Job started at 18/12/2016 13:18:08
    [ Debug ]
    [ Debug ] Running on: Unix 4.4.13.0
    [ Debug ] Environment: 4.0.30319.17020
    [ Debug ] Mono version: 4.2.1 (Debian )
    [ Debug ]
    [ Debug ] Loading timezone data
    [ Debug ] Embedded timezones source: WGconsole.WG.Common.timezonesdata.txt
    [ Debug ] Reading config file: WebGrab++.config.xml
    [ Info ] found: http://siteini.pack/UK/tvguide.co.uk.ini -- Revision 14
    [ Info ] input file /storage/.kodi/userdata/addon_data/service.webgrabplus/guide_wgp.xml not found ... created a new one ...
    [ Info ]
    [ Info ]
    [ Info ] i=index .=same c=change g=gab r=replace n=new
    [ Info ]
    [ Info ]
    [ Info ] Group (0) :
    [ Info ] update requested for - 539 - out of - 539 - channels for 2 day(s)
    [ Debug ]
    [ Info ] ( 1/539 ) TVGUIDE.CO.UK -- chan. (xmltv_id=&TV) -- mode Incremental
    [Warning ] error downloading page: The request timed out (5sec)
    [Warning ] Retry 1 of 4 times
    [Warning ] error downloading page: The request timed out (5sec)
    [Warning ] Retry 1 of 4 times
    [Warning ] error downloading page: The request timed out (10sec)
    [Warning ] Retry 2 of 4 times
    [Warning ] error downloading page: The request timed out (5sec)
    [Warning ] Retry 1 of 4 times

    Config:

    <?xml version="1.0"?>
    <!-- Configuration file for WebGrab+Plus, the incremental Electronic-Program-Guide web grabber
    by Jan van Straaten, December 2011
    Version V1.1.1 -->

    <settings>
    <!-- filename
    The path (required) + filename where the epgguide xml file is /will be located. It must include drive and folder. Like C:\ProgramData\ServerCare\WebGrab\guide.xml
    If the file already exist (from last run or from another xmltv source) it will read it and use what fits the requested output. In that case the file will be updated. If no such file exist it will be created.
    Change the following to your own needs :
    -->
    <filename>/storage/.kodi/userdata/addon_data/service.webgrabplus/guide_wgp.xml</filename>
      
    <!-- modes:
    d or debug saves the output xmltv file in a file with -debug addition in the file name . The original xmltv file will be kept.
    m or measure measures the time for each updated show or new show added
    n = nomark disables the update-type marking (n) (c) (g) (r) at the end of the description
    v or verify verifies the result following a channel update
    w or wget use wget as grab engine (might improve site recognition in rare cases)
    Note that modes can be added in one line, separated by comma's or spaces, or both.
    -->
    <mode>m</mode>
      
    <!-- postprocess:
    Optional , specifies which of the available postprocesses should run.
    syntax: <postprocess run="" grab="">processname</postprocess>
      
    (optional) grab="yes" or "y" or "true" or "on" : grabs epg first (default) ; "no" or "n" or "false" or "off" : skip epg grabbing
    (optional) run="yes" or "y" or "true" or "on" : runs the postprocess (default) ; "no" or "n" or "false" or "off" : do not run post process
    processname: the process to run :
    processname = mdb runs a build in movie database grabber (read / adapt ...\mdb\mdb.confif.xml
    processname = rex runs a postprocess that re-allocates xmltv elements (read / adapt ...\rex\rex.config.xml)
    examples:
    <postprocess run="on" grab="on">mdb</postprocess> grabs first , then run mdb
    <postprocess>mdb</postprocess> same as above (uses defaults for grab and run)
    <postprocess grab="no">rex</postprocess> runs rex without grab (existing xmltv file)
    -->
    <postprocess run="n" grab="y">mdb</postprocess>
      
    <!-- proxy:
    This setting is only required if your computer is connected to internet behind a proxy
    specify proxy address as ip:port like <proxy>192.168.2.4:8080</proxy>
    or as <proxy>automatic</proxy> which attempts to read the proxy address from your connection settings. If your proxy requires a username and password, add them like
    <proxy user="username" password="password">192.168.2.4:8080</proxy>
    <proxy>192.168.2.2:8080</proxy>
    -->
    <proxy>automatic</proxy>

    <!-- user agent:
    The user agent string that is sent to the tvguide website. Some sites require this. Valid values are either
    , in which case the program generates a random string, or any other string like <user-agent>Mozilla/5.0 (Windows; U; MSIE 9.0; WIndows NT 9.0; en-US)</user-agent> <user-agent>random</user-agent><user-agent>Mozilla/5.0 (Windows; U; MSIE 9.0; WIndows NT 9.0; en-US)</user-agent><user-agent>Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3</user-agent>
    -->
    <user-agent>Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0; yie9)</user-agent>
      
      
    <!-- logging:
    simply put 'on' in there to start logging, anything else will turn it off
    -->
    <logging>on</logging>

    <!--retry
    The most simple form of retry defines the amount of times the grabber engine should attempt to capture a web page before giving up and continuing with the next page, like <retry>4</retry>
    It is also the place to specify delays between retries and the grabbing of html pages with the following attributes: timeout; the delay between retries (default is 10 sec), channel-delay; the delay between subsequent channels (default is 0), index-delay; the delay between the grabbing of index pages (default is 0), show-delay; the delay between the grabbing of detail show pages (default is 0). In the most complete version it will look like this:
    <retry time-out="5" channel-delay="5" index-delay="1" show-delay="1">4</retry> show-delay="2"
    -->
    <retry time-out="5">4</retry>

    <!--skip
    It takes two values H,m separated by a comma:
    The first H : if a show takes more than H hours, it's either tellsell or other commercial fluff, or simply a mistake or error, we want to skip such shows.
    The second m : if a show is less or equal than m minutes it is probably an announcement , in any case not a real show.
    When entered as <skip></skip> the defaults are 12 hours, 1 minute, same as <skip>12,1</skip>. To disable this function enter or just leave out this entry completely<skip>14, 1</skip><skip>16,1</skip>
    -->
      
    <skip>noskip</skip>
      
    <!--timespan
    The timespan for which shows will be grabbed.
    It takes one or two values separated by a comma or a space. The first is the number of days (including today) to download, note that 0 is today. The second (optional) is a time specified between 0:00 and 24:00 which will reduce the download to only the one show (per day) which is scheduled around the specified time. Any value between start time (including) and stop time will do
    This -one-show-only mode is helpfull if a SiteIni file needs to be debugged
    -->
    <timespan>1</timespan>

    <!-- update mode
    i or incremental only updates of changes , gabs, repairs and new shows
    l or light forces update of today and new shows, rest as incremental
    s or smart forces update of today and tomorrow and new shows, rest as light
    f or full or force forces full update
    If one of these values is entered here it will apply to all channels selected for update
    (see channel). This value overrules the value of 'update' for in the individual channels
    If no value is entered here the individual 'update' values from the channellist are taken
    -->
    <update></update>

    <!-- The channel-list :
    Each channel to be grabbed has a separate entry in the list, the most common form is:
    <channel update=.. site=.. site_id=.. xmltv_id=.. >display-name</channel>
    Besides this form, there is a possibility to specify special channels like 'combi-channels' and 'timeoffset-channels', see further down for more information-->
    <!-- Channel list files :
    The easiest way to compose this channel-list is to copy the required channels from the channel-list files which can be found in the SiteIni.Pack for nearly every supported tvguide site. -->
    <!-- update :
    The mode values here can be set for each channel differently if not overruled by the general update setting (see above). Allowed values are as the same as the general update setting. Any other value will be ignored. If any of the allowed values of 'update' is entered, this channel will be updated , no value no update ! In that case the epg data of that channel will remain as it is. -->
    <!-- site:
    The website to be used to get the EPG from. The value entered here is the name of the .ini file that supplies the specific parameters for the site without .ini extension.
    e.g tvgids.nl.ini becomes site="tvgids.nl" and gids.publiekeomroep.nl.ini becomes site="gids.publiekeomroep.nl".-->
    <!-- site_id:
    This is the number or text used by the site as reference to the correct html page for this channel. It is used by the program to compose the url for the shows for a channel. For nearly all sites supported by the program a channel-list file is provided in the siteini-pack. It list most of the available channels including this site_id -->
    <!-- xmltv_id :
    The xmltv_id can be any string that suits your needs, you will find it back as the "channel" in your xml file as in :
    <programme start="20100218072500 +0200" stop="20100218075500 +0200" channel="RTL7-id"> -->
    <!-- display-name: This will be used in the xmltv file to give the channel's displayname. That is the name the epgprogram will use to display the channel. Give it any value you like. It is no problem if site_id , xmltv_id and display-name are equal -->
    <!-- Important !
    Be aware that all channels entered here will be included in the xmltv channel table even if no update is requested. This allows the update of individual channels without affecting the data of the others in the list. A channel not in this list will be removed from your xmltv listing together with all the show data of it if found there by WebGrab+Plus. (If you use WebGrab+Plus with a xmltv input file from another source, it will remove all data from channels not in this list and create an entry for new channels)
    WebGrab+Plus uses the xmltv_id to identify a channel in an existing xmltv file.
    -->
    <channel update="i" site="tvguide.co.uk" site_id="965" xmltv_id="&amp;TV">&amp;TV</channel>
    <channel update="i" site="tvguide.co.uk" site_id="953" xmltv_id="?TV">?TV</channel>
    <channel update="i" site="tvguide.co.uk" site_id="533" xmltv_id="3e">3e</channel>
    <channel update="i" site="tvguide.co.uk" site_id="506" xmltv_id="4Music">4Music</channel>

    Thanks

    Edited once, last by Sadams1980 (December 18, 2016 at 1:40 PM).

  • tried with Userdata (capital U)

    has anyone else got this working... driving me nuts :(

    i've tried fresh installs without changing the xml filename in the config.. same issue

    is this broken?

    i fixed my issue but not using smb link for tvheadend settings.
    I enabled view hidden files, and used the config to linkto it that way instead of over samba. works good.

  • Hi all,

    I managed to get Webgrabplus addon working in TVHeadend and the EPG is populating. I uploaded guide.xml into the XMLTV setting in TVHeadend config in the addon. The only issue I am having is with the TVHeadend guide timeline, this is not populating?

    Any ideas?

    Edit: All working now, just had to be patient and let it populate.

    Edited once, last by Sadams1980 (December 20, 2016 at 5:52 PM).

  • @ awaiuy, I just installed the add-on, but on the GUI it appears there is nothing here to configure, so I went to the userdata where I located webgrabplus folder, in this folder there are several folders and several xml.
    But I can't figure out what is next meaning what need to be configure at this stage, I live in Canada, so how do I configure Kodi epg grab the file from an output location.
    Although I checked the log file, but I am not sure of what is entails LOL, appreciate if you kindly write a dummy steps for people like who have no clue how to get this to work.

    Thanks for you support
    log file


    [ ]
    [ ] WebGrab+Plus/w MDB & REX Postprocess -- version V1.57
    [ ]
    [ ] Jan van Straaten
    [ ] Francis De Paemeleere
    [ ]
    [ ] thanks to Paul Weterings and all the contributing users
    [ ] --------------------------------------------------------------------------------
    [ ]
    [ ] Job started at 10/01/2017 15:57:51
    [ Debug ]
    [ Debug ] Running on: Unix 4.9.0.0
    [ Debug ] Environment: 4.0.30319.17020
    [ Debug ] Mono version: 4.2.1 (Debian )
    [ Debug ]
    [ Debug ] Loading timezone data
    [ Debug ] Embedded timezones source: WGconsole.WG.Common.timezonesdata.txt
    [ Debug ] Reading config file: WebGrab++.config.xml
    [ Info ] found: http://siteini.pack/France/telerama.fr.ini -- Revision 09
    [ Debug ] xmltv input file - /storage/.kodi/userdata/addon_data/service.webgrabplus/guide_wgp.xml - found
    [ Debug ] 0 superfluous shows removed
    [Error ] Could find existing channel (xmltv_id=Arte) in the config file
    [ Info ]
    [ Info ]
    [ Info ] i=index .=same c=change g=gab r=replace n=new
    [ Info ]
    [ Info ]
    [ Info ] Group (0) :
    [ Info ] update requested for - 1 - out of - 1 - channels for 2 day(s)
    [ Debug ]
    [ Info ] ( 1/1 ) TELERAMA.FR -- chan. (xmltv_id=Arte) -- mode Incremental
    [Warning ] error downloading page: Error getting response stream (ReadDone2): ReceiveFailure
    [Warning ] pausing 1 of 6 times for 10 seconds before re-try.
    [Warning ] error downloading page: Error getting response stream (ReadDone2): ReceiveFailure
    [Warning ] pausing 2 of 6 times for 20 seconds before re-try.
    [Warning ] error downloading page: Error getting response stream (ReadDone2): ReceiveFailure
    [Warning ] pausing 3 of 6 times for 30 seconds before re-try.
    [Warning ] error downloading page: Error getting response stream (ReadDone2): ReceiveFailure
    [Warning ] pausing 1 of 6 times for 10 seconds before re-try.
    [Warning ] error downloading page: Error getting response stream (ReadDone2): ReceiveFailure
    [Warning ] pausing 1 of 6 times for 10 seconds before re-try.
    [ Info ] 7.19 sec/update
    [ Debug ]
    [ Debug ] 55 shows in 1 channels
    [ Debug ] 37 updated shows
    [ Debug ] 0 new shows added
    [ Info ]
    [ Info ]
    [ ] Job finished at 10/01/2017 16:02:26 done in 4m 35s
    [ Debug ] statistics upload error: The remote server returned an error: (500) Internal Server Error.