Mailing List Archive

Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data
List -

There is another New version of the imdb-bulk-update.pl tool available.

A few new behaviors / changes added in this release.

-If duplicates are found in IMDB results, and -Dupskip is not set, the first
entry in the list is assumed correct. So basically [0] is the default.

-Exclude flag has been added. This will give the user the option of ignoring
those entries that find no results from all future -N searches.

Notice: This is best with the -N flag, as the data set it is searching for
are those that currently have no entry. If you -Exclude with -A, you could
wipe all those entries you may have manually entered IMDB numbers for.

-help was added for extended examples

-The coverart directory will be pulled from the DB if not specified in the
arguments.

Download link is the same:

http://www.4shared.com/file/23145905/548ed5c2/imdbupdatertar.html

Ryan



> List-
>
> There is a new version of the imdb-bulk-update.pl tool available.
>
> In this version I included a -Fileup switch to find all new files(of
> allowable & predefined default file extensions), and compare them with the
> DB information. It'll remove all entries for files that no longer exist,
> and add all new files that have no information in the DB.
>
> I also added a -Manual switch to force a manual entry of IMDBID. This is
> quite handy when searching for a specific stubborn title with -Title
> switch.
>
> The download URL is the same for now. Eventually it'll get moved to atrpms
> with the rest of mythdora utilities.
>
> http://www.4shared.com/file/23145905/548ed5c2/imdbupdatertar.html
>
> Feedback is appreciated.
>
> Ryan
>
>
>
>> List --
>> I've taken the liberty of creating an imdb.pl wrapper to use with
>> mythvideo. This is a commandline tool similar to the imdbbatchgrabber.pl
>> tool that is included with knoppmyth. However that tool is out of date,
>> and it heavily relies on the production copy of imdb.pl. So when imdb.pl
>> is out of date the batchgrabber is instantly, and tends to stay that way
>> for a long time.
>>
>> Anyhow, long story short. I've created a simple, but reliable bulk
>> wrapper
>> for imdb.pl to do batch updates of multiple types against your
>> videometadata table.
>>
>> The script still has a dependency on imdb.pl, but in the past this seems
>> to be maintained regularly and my tool only depends on a working copy.
>>
>> Anyhow, I have it out on a freebie file share site for now (takes a
>> second
>> to load download link). But have at it for those that are interested.
>>
>> http://www.4shared.com/file/23145905/548ed5c2/imdbupdatertar.html
>>
>> The usage is pretty self explanatory. Please send me feedback as
>> necessary.
>>
>> Ryan
>>
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>List -
>
>There is another New version of the imdb-bulk-update.pl tool available.
>
>A few new behaviors / changes added in this release.
>
>-If duplicates are found in IMDB results, and -Dupskip is not set, the
>first entry in the list is assumed correct. So basically [0] is the
default.
>
>-Exclude flag has been added. This will give the user the option of
>ignoring those entries that find no results from all future -N searches.
>
>Notice: This is best with the -N flag, as the data set it is searching for
>are those that currently have no entry. If you -Exclude with -A, you could
>wipe all those entries you may have manually entered IMDB numbers for.
>
>-help was added for extended examples
>
>-The coverart directory will be pulled from the DB if not specified in the
>arguments.
>
>Download link is the same:
>
>http://www.4shared.com/file/23145905/548ed5c2/imdbupdatertar.html
>
>Ryan

Thanks for the new features Ryan.

I have noticed a few oddities with running the following command:
/home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
The .m2v files for some reason these are continually being marked as new
files?

Even though I can see them in the db.


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>
> I have noticed a few oddities with running the following command:
> /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
> The .m2v files for some reason these are continually being marked as new
> files?
>
> Even though I can see them in the db.


Hmm. I can't see to find anything in the code that would cause this.

Give me 2 things. One of the at fault filenames with the full path
/movies/etc/etc/filensame.m2v

And then give me the output from this:

echo select extension, f_ignore from videotypes\; | mysql -umythtv
-pmythtv mythconverg

This assumes that your user/pass and db are the defaults of course.

Ryan


>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
the mysql command for mi on suse 10.2 would be
echo select extension, f_ignore from videotypes\; | mysql --password=mythtv -u
mythtv mythconverg

Le Sunday 23 September 2007 13:31:07 Ryan Pisani, vous avez écrit :
> > I have noticed a few oddities with running the following command:
> > /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
> > The .m2v files for some reason these are continually being marked as new
> > files?
> >
> > Even though I can see them in the db.
>
> Hmm. I can't see to find anything in the code that would cause this.
>
> Give me 2 things. One of the at fault filenames with the full path
> /movies/etc/etc/filensame.m2v
>
> And then give me the output from this:
>
> echo select extension, f_ignore from videotypes\; | mysql -umythtv
> -pmythtv mythconverg
>
> This assumes that your user/pass and db are the defaults of course.
>
> Ryan
>
> > _______________________________________________
> > mythtv-users mailing list
> > mythtv-users@mythtv.org
> > http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users



--
______________________________________________________________
Philippe Demartin

Mail: philippe@demartinenchile.com
Web: www.demartinenchile.com
tel: +56 32 277 20 53
Cel: +56 9 278 28 68
Skype: phdemart
______________________________________________________________
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>
>>
>> I have noticed a few oddities with running the following command:
>> /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
>> The .m2v files for some reason these are continually being marked as new
>> files?
>>
>> Even though I can see them in the db.
>
>
> Hmm. I can't see to find anything in the code that would cause this.
>
> Give me 2 things. One of the at fault filenames with the full path
> /movies/etc/etc/filensame.m2v
>
> And then give me the output from this:
>
> echo select extension, f_ignore from videotypes\; | mysql -umythtv
> -pmythtv mythconverg
>
> This assumes that your user/pass and db are the defaults of course.
>
> Ryan

/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v


| extension | f_ignore |
+-----------+----------+
| txt | 1 |
| log | 1 |
| mpg | 0 |
| avi | 0 |
| vob | 0 |
| mpeg | 0 |
| VIDEO_TS | 0 |
| iso | 0 |
| img | 0 |
| rmvb | 0 |
| jpg | 1 |
| png | 1 |
| gif | 1 |
| cue | 1 |
| sub | 1 |
| srt | 1 |
| dat | 1 |
| mp4 | 0 |
| m2v | 0 |
+-----------+----------+
19 rows in set (0.00 sec)

Thanks Anthony


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>>
>>>
>>> I have noticed a few oddities with running the following command:
>>> /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
>>> The .m2v files for some reason these are continually being marked as
>>> new
>>> files?
>>>
>>> Even though I can see them in the db.
>>
>>
>> Hmm. I can't see to find anything in the code that would cause this.
>>
>> Give me 2 things. One of the at fault filenames with the full path
>> /movies/etc/etc/filensame.m2v
>>
>> And then give me the output from this:
>>
>> echo select extension, f_ignore from videotypes\; | mysql -umythtv
>> -pmythtv mythconverg
>>
>> This assumes that your user/pass and db are the defaults of course.
>>
>> Ryan
>
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v
>
>
> | extension | f_ignore |
> +-----------+----------+
> | txt | 1 |
> | log | 1 |
> | mpg | 0 |
> | avi | 0 |
> | vob | 0 |
> | mpeg | 0 |
> | VIDEO_TS | 0 |
> | iso | 0 |
> | img | 0 |
> | rmvb | 0 |
> | jpg | 1 |
> | png | 1 |
> | gif | 1 |
> | cue | 1 |
> | sub | 1 |
> | srt | 1 |
> | dat | 1 |
> | mp4 | 0 |
> | m2v | 0 |
> +-----------+----------+
> 19 rows in set (0.00 sec)
>
> Thanks Anthony
>


Ok. Nothing looks out of sorts there. Can you tell me what the output of
this is:

select * from videometadata where filename like "%A Perfect Circle%"


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>>>
>>>>
>>>> I have noticed a few oddities with running the following command:
>>>> /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
>>>> The .m2v files for some reason these are continually being marked as
>>>> new
>>>> files?
>>>>
>>>> Even though I can see them in the db.
>>>
>>>
>>> Hmm. I can't see to find anything in the code that would cause this.
>>>
>>> Give me 2 things. One of the at fault filenames with the full path
>>> /movies/etc/etc/filensame.m2v
>>>
>>> And then give me the output from this:
>>>
>>> echo select extension, f_ignore from videotypes\; | mysql -umythtv
>>> -pmythtv mythconverg
>>>
>>> This assumes that your user/pass and db are the defaults of course.
>>>
>>> Ryan
>>
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v
>>
>>
>> | extension | f_ignore |
>> +-----------+----------+
>> | txt | 1 |
>> | log | 1 |
>> | mpg | 0 |
>> | avi | 0 |
>> | vob | 0 |
>> | mpeg | 0 |
>> | VIDEO_TS | 0 |
>> | iso | 0 |
>> | img | 0 |
>> | rmvb | 0 |
>> | jpg | 1 |
>> | png | 1 |
>> | gif | 1 |
>> | cue | 1 |
>> | sub | 1 |
>> | srt | 1 |
>> | dat | 1 |
>> | mp4 | 0 |
>> | m2v | 0 |
>> +-----------+----------+
>> 19 rows in set (0.00 sec)
>>
>> Thanks Anthony
>>
>
>
> Ok. Nothing looks out of sorts there. Can you tell me what the output of
> this is:
>
> select * from videometadata where filename like "%A Perfect Circle%"

Ahhh its also inserting it into the Database multiple times

+-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
| intid | title | director | plot | rating |
inetref | year | userrating | length | showlevel | filename
| coverfile | childid |
browse | playcommand | category |
+-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
| 816 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 706 | A Perfect Circle - Passive.m2v | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 808 | A Perfect Circle - Passive.m2v | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 821 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 853 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 963 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 968 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 980 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 975 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 987 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 992 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1013 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1028 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1033 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1038 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1043 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1048 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1053 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1058 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1063 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1068 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1073 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
| 1078 | A Perfect Circle - Passive | Unknown | Unknown | NR |
99999999 | 1895 | 0 | 0 | 0 |
/storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
No Cover | -1 | 1 | NULL | 0 |
+-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
23 rows in set (0.01 sec)


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>>>>
>>>>>
>>>>> I have noticed a few oddities with running the following command:
>>>>> /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
>>>>> The .m2v files for some reason these are continually being marked as
>>>>> new
>>>>> files?
>>>>>
>>>>> Even though I can see them in the db.
>>>>
>>>>
>>>> Hmm. I can't see to find anything in the code that would cause this.
>>>>
>>>> Give me 2 things. One of the at fault filenames with the full path
>>>> /movies/etc/etc/filensame.m2v
>>>>
>>>> And then give me the output from this:
>>>>
>>>> echo select extension, f_ignore from videotypes\; | mysql -umythtv
>>>> -pmythtv mythconverg
>>>>
>>>> This assumes that your user/pass and db are the defaults of course.
>>>>
>>>> Ryan
>>>
>>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v
>>>
>>>
>>> | extension | f_ignore |
>>> +-----------+----------+
>>> | txt | 1 |
>>> | log | 1 |
>>> | mpg | 0 |
>>> | avi | 0 |
>>> | vob | 0 |
>>> | mpeg | 0 |
>>> | VIDEO_TS | 0 |
>>> | iso | 0 |
>>> | img | 0 |
>>> | rmvb | 0 |
>>> | jpg | 1 |
>>> | png | 1 |
>>> | gif | 1 |
>>> | cue | 1 |
>>> | sub | 1 |
>>> | srt | 1 |
>>> | dat | 1 |
>>> | mp4 | 0 |
>>> | m2v | 0 |
>>> +-----------+----------+
>>> 19 rows in set (0.00 sec)
>>>
>>> Thanks Anthony
>>>
>>
>>
>> Ok. Nothing looks out of sorts there. Can you tell me what the output of
>> this is:
>>
>> select * from videometadata where filename like "%A Perfect Circle%"
>
> Ahhh its also inserting it into the Database multiple times
>
> +-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
> | intid | title | director | plot | rating |
> inetref | year | userrating | length | showlevel | filename
> | coverfile | childid |
> browse | playcommand | category |
> +-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
> | 816 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 706 | A Perfect Circle - Passive.m2v | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 808 | A Perfect Circle - Passive.m2v | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 821 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 853 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 963 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 968 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 980 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 975 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 987 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 992 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1013 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1028 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1033 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1038 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1043 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1048 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1053 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1058 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1063 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1068 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1073 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> | 1078 | A Perfect Circle - Passive | Unknown | Unknown | NR |
> 99999999 | 1895 | 0 | 0 | 0 |
> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
> No Cover | -1 | 1 | NULL | 0 |
> +-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
> 23 rows in set (0.01 sec)
>
>

Anthony --
I think I found the issue. When I do the sort I use a hash to compare the
files already in the DB and those that are on the Filesystem. In doing so
the comparison I am making does a if the count is != 2, then we'll add it.
Here is my mistake, I made the assumption that for any given title only 1
entry would exist in the DB.

I expect that your videometadata table actually had more than 1 entry
listed for this particular file, so the comparison of the files was not
equal to 2, it may have been 3 or 4 or now 23..... so everytime this check
is true and again adds it to the DB.

I'm going to fix this check to make it >= instead which should prevent
this from happening for everyone. To get this entry out of your DB, I'd
say rename this file, and re-run the -Fileup for now. This should clean up
that particular entry.

I'll fix the script and post a new version shortly.

Ryan


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>>>>>
>>>>>>
>>>>>> I have noticed a few oddities with running the following command:
>>>>>> /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
>>>>>> The .m2v files for some reason these are continually being marked as
>>>>>> new
>>>>>> files?
>>>>>>
>>>>>> Even though I can see them in the db.
>>>>>
>>>>>
>>>>> Hmm. I can't see to find anything in the code that would cause this.
>>>>>
>>>>> Give me 2 things. One of the at fault filenames with the full path
>>>>> /movies/etc/etc/filensame.m2v
>>>>>
>>>>> And then give me the output from this:
>>>>>
>>>>> echo select extension, f_ignore from videotypes\; | mysql -umythtv
>>>>> -pmythtv mythconverg
>>>>>
>>>>> This assumes that your user/pass and db are the defaults of course.
>>>>>
>>>>> Ryan
>>>>
>>>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v
>>>>
>>>>
>>>> | extension | f_ignore |
>>>> +-----------+----------+
>>>> | txt | 1 |
>>>> | log | 1 |
>>>> | mpg | 0 |
>>>> | avi | 0 |
>>>> | vob | 0 |
>>>> | mpeg | 0 |
>>>> | VIDEO_TS | 0 |
>>>> | iso | 0 |
>>>> | img | 0 |
>>>> | rmvb | 0 |
>>>> | jpg | 1 |
>>>> | png | 1 |
>>>> | gif | 1 |
>>>> | cue | 1 |
>>>> | sub | 1 |
>>>> | srt | 1 |
>>>> | dat | 1 |
>>>> | mp4 | 0 |
>>>> | m2v | 0 |
>>>> +-----------+----------+
>>>> 19 rows in set (0.00 sec)
>>>>
>>>> Thanks Anthony
>>>>
>>>
>>>
>>> Ok. Nothing looks out of sorts there. Can you tell me what the output
>>> of
>>> this is:
>>>
>>> select * from videometadata where filename like "%A Perfect Circle%"
>>
>> Ahhh its also inserting it into the Database multiple times
>>
>> +-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
>> | intid | title | director | plot | rating |
>> inetref | year | userrating | length | showlevel | filename
>> | coverfile | childid |
>> browse | playcommand | category |
>> +-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
>> | 816 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 706 | A Perfect Circle - Passive.m2v | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 808 | A Perfect Circle - Passive.m2v | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 821 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 853 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 963 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 968 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 980 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 975 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 987 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 992 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1013 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1028 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1033 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1038 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1043 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1048 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1053 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1058 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1063 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1068 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1073 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> | 1078 | A Perfect Circle - Passive | Unknown | Unknown | NR |
>> 99999999 | 1895 | 0 | 0 | 0 |
>> /storage/videos/movies/music videos/DVD/A Perfect Circle - Passive.m2v |
>> No Cover | -1 | 1 | NULL | 0 |
>> +-------+--------------------------------+----------+---------+--------+----------+------+------------+--------+-----------+------------------------------------------------------------------------+-----------+---------+--------+-------------+----------+
>> 23 rows in set (0.01 sec)
>>
>>
>
> Anthony --
> I think I found the issue. When I do the sort I use a hash to compare the
> files already in the DB and those that are on the Filesystem. In doing so
> the comparison I am making does a if the count is != 2, then we'll add it.
> Here is my mistake, I made the assumption that for any given title only 1
> entry would exist in the DB.
>
> I expect that your videometadata table actually had more than 1 entry
> listed for this particular file, so the comparison of the files was not
> equal to 2, it may have been 3 or 4 or now 23..... so everytime this check
> is true and again adds it to the DB.
>
> I'm going to fix this check to make it >= instead which should prevent
> this from happening for everyone. To get this entry out of your DB, I'd
> say rename this file, and re-run the -Fileup for now. This should clean up
> that particular entry.
>
> I'll fix the script and post a new version shortly.
>
> Ryan
>
>


here are some comments from another user which I also had some issues with

http://www.gossamer-threads.com/lists/mythtv/users/291665?search_string=include%20in%20myth%20the%20videos%20cast;#291665

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>
> here are some comments from another user which I also had some issues with
>
> http://www.gossamer-threads.com/lists/mythtv/users/291665?search_string=include%20in%20myth%20the%20videos%20cast;#291665

I see the comments here, but I don't understand the correlation with this
issue you're having?

The new version with another fix will be posted in the next 1/2 hour or so.

Ryan
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>
>>
>> here are some comments from another user which I also had some issues
>> with
>>
>> http://www.gossamer-threads.com/lists/mythtv/users/291665?search_string=include%20in%20myth%20the%20videos%20cast;#291665
>
> I see the comments here, but I don't understand the correlation with this
> issue you're having?
>
> The new version with another fix will be posted in the next 1/2 hour or
> so.
>
> Ryan

Sorry I didn't explain myself, Another issue I had which I was trying to
investigate before I posted is in some instances I was also not seeing
some newly added files in mythvideo even though they were in the database
as it appears the showlevel is defaulting too 0?
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>>
>>>
>>> here are some comments from another user which I also had some issues
>>> with
>>>
>>> http://www.gossamer-threads.com/lists/mythtv/users/291665?search_string=include%20in%20myth%20the%20videos%20cast;#291665
>>
>> I see the comments here, but I don't understand the correlation with
>> this
>> issue you're having?
>>
>> The new version with another fix will be posted in the next 1/2 hour or
>> so.
>>
>> Ryan
>
> Sorry I didn't explain myself, Another issue I had which I was trying to
> investigate before I posted is in some instances I was also not seeing
> some newly added files in mythvideo even though they were in the database
> as it appears the showlevel is defaulting too 0?


On a side note. I found the bug that I believe was causing your Perfect
Circle m2v to enter multiple times. However, I expect that the script
should have been exiting with an error the times that the bug was in
effect.

I'm guessing maybe other users may have squeaked by with 1.4 version
because they have no new files to put in the DB. I will post 1.5 soon in a
new thread and hopefully all users will pick that new version up. Cause
1.4 was not good with this bug.

Did you correct your duplicate entries yet?

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
>>
>>>
>>> here are some comments from another user which I also had some issues
>>> with
>>>
>>> http://www.gossamer-threads.com/lists/mythtv/users/291665?search_string=include%20in%20myth%20the%20videos%20cast;#291665
>>
>> I see the comments here, but I don't understand the correlation with
>> this
>> issue you're having?
>>
>> The new version with another fix will be posted in the next 1/2 hour or
>> so.
>>
>> Ryan
>
> Sorry I didn't explain myself, Another issue I had which I was trying to
> investigate before I posted is in some instances I was also not seeing
> some newly added files in mythvideo even though they were in the database
> as it appears the showlevel is defaulting too 0?
> _______________________________________________
>

New version uploaded. 1.5.1 same link:

http://www.4shared.com/file/23145905/548ed5c2/imdbupdatertar.html
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
If you vant to see the new behviour, you will need to remove the entry with
the showlevel to "0" and run the Bulk Updater again
An easy way is thru knoda or with a query like
mysql --password=mythtv -u mythtv -h localhost mythconverg -sN -e "DELETE from
videometadata where showlevel="0" ;"

changing the pass etc for your

Le Monday 24 September 2007 11:31:42 Ryan Pisani, vous avez écrit :
> >>> here are some comments from another user which I also had some issues
> >>> with
> >>>
> >>> http://www.gossamer-threads.com/lists/mythtv/users/291665?search_string
> >>>=include%20in%20myth%20the%20videos%20cast;#291665
> >>
> >> I see the comments here, but I don't understand the correlation with
> >> this
> >> issue you're having?
> >>
> >> The new version with another fix will be posted in the next 1/2 hour or
> >> so.
> >>
> >> Ryan
> >
> > Sorry I didn't explain myself, Another issue I had which I was trying to
> > investigate before I posted is in some instances I was also not seeing
> > some newly added files in mythvideo even though they were in the database
> > as it appears the showlevel is defaulting too 0?
> > _______________________________________________
>
> New version uploaded. 1.5.1 same link:
>
> http://www.4shared.com/file/23145905/548ed5c2/imdbupdatertar.html
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users



--
______________________________________________________________
Philippe Demartin

Mail: philippe@demartinenchile.com
Web: www.demartinenchile.com
tel: +56 32 277 20 53
Cel: +56 9 278 28 68
Skype: phdemart
______________________________________________________________
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
Re: New Version: 1.4 Bulk Updater for Videometa(imdb) data [ In reply to ]
> the mysql command for mi on suse 10.2 would be
> echo select extension, f_ignore from videotypes\; | mysql
> --password=mythtv -u
> mythtv mythconverg

Alterternatively you could just set the 0 to 1 instead of re-importing all
videos & data with:

echo update videometadata set showlevel=1 where showlevel=0\; | mysql
-umythtv -pmythtv mythconverg



> Le Sunday 23 September 2007 13:31:07 Ryan Pisani, vous avez écrit :
>> > I have noticed a few oddities with running the following command:
>> > /home/mythtv/imdbupdater/imdb-bulk-update.pl -N -Fileup -Exclude
>> > The .m2v files for some reason these are continually being marked as
>> new
>> > files?
>> >
>> > Even though I can see them in the db.
>>
>> Hmm. I can't see to find anything in the code that would cause this.
>>
>> Give me 2 things. One of the at fault filenames with the full path
>> /movies/etc/etc/filensame.m2v
>>
>> And then give me the output from this:
>>
>> echo select extension, f_ignore from videotypes\; | mysql -umythtv
>> -pmythtv mythconverg
>>
>> This assumes that your user/pass and db are the defaults of course.
>>
>> Ryan
>>
>> > _______________________________________________
>> > mythtv-users mailing list
>> > mythtv-users@mythtv.org
>> > http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>>
>> _______________________________________________
>> mythtv-users mailing list
>> mythtv-users@mythtv.org
>> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
>
>
>
> --
> ______________________________________________________________
> Philippe Demartin
>
> Mail: philippe@demartinenchile.com
> Web: www.demartinenchile.com
> tel: +56 32 277 20 53
> Cel: +56 9 278 28 68
> Skype: phdemart
> ______________________________________________________________
>

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users