| T O P I C R E V I E W |
| micklecat |
Posted - 20 Jun 2021 : 10:31:02
I use XMM10. Main script for downloading movie data is, of course, IMDB. For a long time it worked incorrectly, downloaded seversl persons as Directors instead of one Director. Now it cannot download movie data at all. No Country, no Year, no Director. And no any updates to script! No new versions of XMM, version 11 is a stub only, it doesn't work. What we paid for? I am ready to pay more, but I want to have a correctly functioning movie database. But it seems like development is abandoned. |
| 20 L A T E S T R E P L I E S (Newest First) |
| JDommi |
Posted - 10 Feb 2024 : 19:07:32
Now it's still killing that the IMDB-Scraper by tarzibou doesn't work anymore 
|
| Sabry |
Posted - 10 Feb 2024 : 11:54:22
Thank you JDommi, now it's ok :-) |
| JDommi |
Posted - 10 Feb 2024 : 11:36:47
I think IMDB will change the code sooner or later again as there is a data-testid once again in the html code.
But so long you only have to modify 2 lines in the #CREATEEPISODELIST#
--------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------- Phase II --------------------------------------------------------
--------------------------------------------------------------------------------------------------------------------------
#CREATEEPISODELIST#
#WRITETITLELIST#=---- List of Episodes Found, Select ALL you want Import and Add in Database:
#PUT#=1#33#
:NEXTSEASON
#STRING#=#41#=https://www.imdb.com/title/tt#48#/episodes/?season=#33#&ref_=ttep_ep_sn_nx
#OPENWEBSLOT1#=#41#
#LOADWEBSLOT1#
#STARTREADWEB#
#PUT#=0#20#
#PUT#=0#00#
#PUT#=1#21#
#FINDLINE#=<h4 data-testid="#12# #ONERROR#=*STOP*
#RESETCURSOR#
#WRITEWARNING#=Season #33#
:REPEATCICLEEPISODES
#FIND#=<h4 data-testid="#12# #ONERROR#=*OK* |
| JDommi |
Posted - 07 Feb 2024 : 18:07:02
Once again 
I will have a look at the weekend. |
| Sabry |
Posted - 07 Feb 2024 : 10:06:39
Hi JDommi, the episodes list doesn't appear anymore :(
Could you please have a look?
Thanks |
| JDommi |
Posted - 14 Jan 2024 : 21:09:32
And now the full script as promised: https://www.mediafire.com/file/rm2z18naz4wn7ar/IMDB.COM_%2528TVSeries%2529_2024.txt/file
#CREATEEPIDOSELIST# is fixed, too.
I didn't have checked any of the info taken for series or episode as I don't wanna have everything in my database. So if you are missing anything I will (try to) do it.
Next up there are 2 things I will do:
1. re-add the meanwhile disabled one or two lists in the additional IMDB script as tarzibou (thanks again!) has fixed the latest changes on IMDB a few weeks ago.
2. fix the IAFD scripts as promised. |
| JDommi |
Posted - 13 Jan 2024 : 18:37:02
Part 1 #CREATEMOVIELIST# now is fixed.
Part2 #CREATEEPISODELIST# will follow soon.
@Kipcior
#CREATEMOVIELIST#
#PUT#=0#17#
#STARTREADWEB#
#FINDLINE#=#FINDLINE#=<ul class="ipc-metadata-list#23##ONERROR#=*OK*
#IF# #23#>>#00#
#GOTO#=SERIESNOTFOUND
#ENDIF#
#STARTREADWEB#
#FINDLINE#=<div class="sc-daafffbc-0 jKMtaG">#10# #ONERROR#=*STOP*
#REPEAT#
#FIND#=div class="sc-daafffbc-0 jKMtaG">#10# #ONERROR#=*STOP*
#PUTCURSOR#=#10#
#FIND#=href="/title/#04#
#FINDPREVIOUS#=class="ipc-image"#11# #ONERROR#=*OK*
#IF# #11#<<#10#
#PUT#=#08#
#LOADCURSOR#=#10#
#GOTO#=NOCOVERPICFOUND
#ENDIF#
#FIND#=src="#04#
#FIND#="#04#
#FIND#=.jpg#05#
#FIND#="#05#
#TAKEWORD#=#08#,#04#,#05# //Coverpic
:NOCOVERPICFOUND
#FIND#= href="#04#
#FIND#="#04#
#FIND#=/?ref_=sr_t_1"#05#
#TAKEWORD#=#06#,#04#,#05# //Link
#FIND#=>#04#
#FIND#=</a>#05#
#TAKEWORD#=#07#,#04#,#05# //Title
#PUT#=0#01#
#PUT#=1#02#
:NEXTSPAN
#PUTCURSOR#=#10#
#FIND#=<div class="sc-daafffbc-0 jKMtaG">#11#
#LOADCURSOR#=#10#
#FIND#=<span class="#04#
#IF# #04#>>#11#
#LOADCURSOR#=#10#
#GOTO#=CHECKINFO
#ENDIF#
#FIND#=>#04#
#FIND#=</span>#05#
#TAKEWORD#=#09#,#04#,#05# //Info
#PUT#=TV Series#12#
#PUT#=TV Mini Series#13#
#IF# #09#==#12#
#PUT#=1#01#
#ENDIF#
#IF# #09#==#13#
#PUT#=1#01#
#ENDIF#
#STRING#=#07#=#07# (#09#)
#GOTO#=NEXTSPAN
:CHECKINFO
#IF# #01#==#02#
#CHECKVARIABLE#=#07#
#STARTSUBSTITUTETAGS#
#CLEARTAGS#
#STARTDELETETAGS#
#WRITETITLELIST#=https://www.imdb.com/#06# ---> #07# §#08#
#ENDIF#
#WHILE# #00#<>#10#
:ENDMLIST
#IF# #17#==#00#
#GOTO#=SERIESNOTFOUND
#ENDIF#
#GOTO#=ENDCREATEMOVIELIST
:SERIESNOTFOUND
// No titles were found
#WRITETITLELIST#= ~~~~~~~~ The script couldn't find any titles matching that name. ~~~~~~~~
#WRITETITLELIST#=
#WRITETITLELIST#= If you know an alternative name for this movie then you could try to enter it
#WRITETITLELIST#= again and after make import again
#WRITETITLELIST#=
#WRITETITLELIST#= If it still doesn't find anything then try to go to this page and search for it manually:
#WRITETITLELIST#= https://www.imdb.com/search
#WRITETITLELIST#=
#WRITETITLELIST#= If you could find it manually then please post a bugreport in this thread in the XMM forum:
#WRITETITLELIST#= http://www.binaryworks.it/forum/topic.asp?TOPIC_ID=772
:ENDCREATEMOVIELIST
#ENDCREATEMOVIELIST# |
| JDommi |
Posted - 09 Jan 2024 : 19:33:04
Thanks 
I will try it this weekend. Maybe I will find a way for recieving only real series.
Btw. the #ENDIF# after #WRITETITLELIST#=https://www.imdb.com/#06# ---> #07# §#08# is too much
3 times #IF# but 4 times #ENDIF#. |
| Kipcior |
Posted - 09 Jan 2024 : 08:53:25
I used the second one.
here is part of my code for MOVIELIST - again, might be dirty and not as clean as yours but at least it creates a list of movies so maybe you'll find sometihng useful in it.
#CREATEMOVIELIST#
#PUT#=0#17#
#STARTREADWEB#
#FINDLINE#=<ul class="ipc-metadata-list#23##ONERROR#=*OK*
#IF# #23#==#00#
#GOTO#=SERIESNOTFOUND
#ENDIF#
#FIND#=<div class="ipc-media ipc-media--poster#10# #ONERROR#=*STOP*
#REPEAT#
#FIND#=<img alt="#10# #ONERROR#=*STOP*
#PUTCURSOR#=#10#
#FIND#= href="/title/#04#
#FINDPREVIOUS#=class="ipc-image"#11# #ONERROR#=*OK*
#IF# #11#<<#10#
#PUT#=#08#
#GOTO#=NOCOVERPICFOUND
#ENDIF#
#FIND#=src="#04#
#FIND#="#04#
#FIND#=.jpg#05#
#FIND#="#05#
#TAKEWORD#=#08#,#04#,#05# //Coverpic
:NOCOVERPICFOUND
#LOADCURSOR#=#10#
#FIND#= href="#04#
#FIND#="#04#
#FIND#=/?ref_=fn_tt_tt#05#
#TAKEWORD#=#06#,#04#,#05# //Link
#FIND#=">#04#
#COMPUTECURSOR#=+1
#PUTCURSOR#=#04#
#FIND#=</a>#05#
#TAKEWORD#=#07#,#04#,#05# //Title
#FIND#=<li role="presentation"#04#
#FIND#=<span class="#04#
#FIND#=>#04#
#FIND#=</span>#05#
#TAKEWORD#=#09#,#04#,#05# //Year(s)
#STRING#=#07#=#07# (#08#) #09#
#CHECKVARIABLE#=#07#
#STARTSUBSTITUTETAGS#
#CLEARTAGS#
#STARTDELETETAGS#
#WRITETITLELIST#=https://www.imdb.com/#06# ---> #07# §#08#
#ENDIF#
#WHILE# #00#<>#10#
:ENDMLIST
#IF# #17#==#00#
#GOTO#=SERIESNOTFOUND
#ENDIF#
#GOTO#=ENDCREATEMOVIELIST
:SERIESNOTFOUND
// No titles were found
#WRITETITLELIST#= ~~~~~~~~ The script couldn't find any titles matching that name. ~~~~~~~~
#WRITETITLELIST#=
#WRITETITLELIST#= If you know an alternative name for this movie then you could try to enter it
#WRITETITLELIST#= again and after make import again
#WRITETITLELIST#=
#WRITETITLELIST#= If it still doesn't find anything then try to go to this page and search for it manually:
#WRITETITLELIST#= https://www.imdb.com/search
#WRITETITLELIST#=
#WRITETITLELIST#= If you could find it manually then please post a bugreport in this thread in the XMM forum:
#WRITETITLELIST#= http://www.binaryworks.it/forum/topic.asp?TOPIC_ID=772
:ENDCREATEMOVIELIST
#ENDCREATEMOVIELIST# |
| JDommi |
Posted - 08 Jan 2024 : 22:34:35
Which Search did you try?
There are 3 different webqueries:
https://www.imdb.com/find/?q=banshee
https://www.imdb.com/find/?s=tt&q=#SERIE#&ref_=nv_sr_sm
https://www.imdb.com/search/title?title=#SERIE#&title_type=tv_series,mini_series&view=simple (this one I have used for the list above. That also was the last working query.)
The strange thing is that I get about 1400 Lines of code instead of about 1800.
And thanks for correcting the missing #, although it doesn't change anything.
Would be great if you can manage it to get the search working, Kipcior! |
| Kipcior |
Posted - 08 Jan 2024 : 21:08:53
I was able to get the list of movies using different search and differnt criteria but after I pick the title from the list, it crashes along the way so still need to work on it. And it is not using advanced search so it retrieves nor only tv show but also normal movies.
Anyhow, I noticed in your script that in line where you form final string of the movie list item, last variable is without ending #:
#STRING#=#07#=#07# (#08#) #09
Not sure if it helps a bit but something to correct for sure.
I also have a different escape condition, at the beginning of block because you're checking using 'greater' operator, while I am using equal to - probably both ways are correct so depends on the approach |
| JDommi |
Posted - 07 Jan 2024 : 18:15:32
Today I have tried again to get the movielist back again - without any success like in the previous tests yesterday 
I don't know what imdb has changed but neither the simple search nor the advanced search seem to pass the data to XMM.
All in all I have now worked on the script for about 8 hours and I become frustrated more and more...
Maybe someone has an idea of how to get the list back again 
If not I will try to make a special loader although I don't know if the MagicScriptEngine is able to process that on the episodes.#CREATEMOVIELIST#
#PUT#=0#17#
#STARTREADWEB#
#FINDLINE#=<div data-testid="no-results-image-container-test-id" class="sc-e6ec60f0-0 cULCE">#23##ONERROR#=*OK*
#IF# #23#>>#00#
#GOTO#=SERIESNOTFOUND
#ENDIF#
#STARTREADWEB#
#FINDLINE#=<div class="sc-53c98e73-3 kttqmq">#10# #ONERROR#=*STOP*
#REPEAT#
#FIND#=div class="sc-53c98e73-3 kttqmq">#10# #ONERROR#=*STOP*
#PUTCURSOR#=#10#
#FIND#=<a href="/title/#04#
#FINDPREVIOUS#=class="ipc-image"#11# #ONERROR#=*OK*
#IF# #11#<<#10#
#PUT#=#08#
#GOTO#=NOCOVERPICFOUND
#ENDIF#
#FIND#=src="#04#
#FIND#="#04#
#FIND#=.jpg#05#
#FIND#="#05#
#TAKEWORD#=#08#,#04#,#05# //Coverpic
:NOCOVERPICFOUND
#LOADCURSOR#=#10#
#FIND#=a href="#04#
#FIND#="#04#
#FIND#=/?ref_=sr_t_1"#05#
#TAKEWORD#=#06#,#04#,#05# //Link
#FIND#=<h3 class="ipc-title__text">#04#
#FIND#=">#04#
#FIND#= #04#
#FIND#=</h3>#05#
#TAKEWORD#=#07#,#04#,#05# //Title
#FIND#=<div class="sc-43986a27-7 #04#
#FIND#=<span class="#04#
#FIND#=>#04#
#FIND#=</span>#05#
#TAKEWORD#=#09#,#04#,#05# //Year(s)
#FIND#=<span class="sc-43986a27-3#04#
#FIND#=>#04#
#FIND#=</span>#05#
#TAKEWORD#=#10#,#04#,#05# //(Mini-)Series
#STRING#=#07#=#07# (#08#) #09
#CHECKVARIABLE#=#07#
#STARTSUBSTITUTETAGS#
#CLEARTAGS#
#STARTDELETETAGS#
#WRITETITLELIST#=https://www.imdb.com/#06# ---> #07# §#08#
#WHILE# #00#<>#10#
:ENDMLIST
#IF# #17#==#00#
#GOTO#=SERIESNOTFOUND
#ENDIF#
#GOTO#=ENDCREATEMOVIELIST
:SERIESNOTFOUND
// No titles were found
#WRITETITLELIST#= ~~~~~~~~ The script couldn't find any titles matching that name. ~~~~~~~~
#WRITETITLELIST#=
#WRITETITLELIST#= If you know an alternative name for this movie then you could try to enter it
#WRITETITLELIST#= again and after make import again
#WRITETITLELIST#=
#WRITETITLELIST#= If it still doesn't find anything then try to go to this page and search for it manually:
#WRITETITLELIST#= https://www.imdb.com/search
#WRITETITLELIST#=
#WRITETITLELIST#= If you could find it manually then please post a bugreport in this thread in the XMM forum:
#WRITETITLELIST#= http://www.binaryworks.it/forum/topic.asp?TOPIC_ID=772
:ENDCREATEMOVIELIST
#ENDCREATEMOVIELIST# |
| Sabry |
Posted - 19 Nov 2023 : 13:42:15
Hi :)
unfortunately it doesn't work.
Please take care of your hand and then have a look on the script when you'll be able to do it, no rush ;)
I will wait for a new updated script on this forum.
Thanks!
|
| JDommi |
Posted - 19 Nov 2023 : 11:23:36
Hi!
Did you have checked the version here: http://www.binaryworks.it/forum/topic.asp?TOPIC_ID=16275?
If it doesn't work I will have a look at it. But I don't know if I can manage it this week although I have holidays.
Unfortunately yesterday I have twisted my right hand when our dog was too fast for me  ... |
| Sabry |
Posted - 18 Nov 2023 : 18:23:11
Hi JDommi, the TV Series script is not working anymore. It doesn't load any shows again... |
| JDommi |
Posted - 13 Nov 2023 : 08:59:53
As I have holidays next week I want to update the IMDB scripts again. To not waste much time on checking which info is broken I wanna ask any of you to note which parts need fixing.
I hope that meanwhile all changes have been made to either the Movie and the TVShow sites... |
| JDommi |
Posted - 24 Oct 2023 : 21:05:32
Episode pic and Plot are fixed:
https://www.mediafire.com/file/78m7zl98yu51d58/_IMDB.COM_2023_%2528TVSeries%2529_For_Rel.8%25284%2529.txt/file
More to come when I have a little more time... |
| JDommi |
Posted - 22 Oct 2023 : 13:34:40
https://www.mediafire.com/file/8238ay52klhuipj/_IMDB.COM_2023_%2528TVSeries%2529_For_Rel.8%25283%2529.txt/file
Still not complete as some episode infos are now missing/wrong but the episodelist works again. |
| JDommi |
Posted - 20 Oct 2023 : 22:12:37
The 11th commandment: You shouldn't mess with IMDB
I will try to have a look as soon as possible. |
| jimini |
Posted - 20 Oct 2023 : 20:07:49
quote:
Originally posted by JDommi
As Sabry has reported here is the fixed #CREATEEPISODELIST# for the IMDB (TVSeries) script.
https://www.mediafire.com/file/zfoxsc6u9ae4v2j/_IMDB.COM_2023_%2528TVSeries%2529_For_Rel.8%25282%2529.txt/file
If only it still worked 2 weeks later... Seems IMDB still continue with tinkering... |
