Introduction

In a previous post, I described how the joining missed out half the data. After making various plots, is turns out the joining was sometimes erroneous too. Hence, I bit the bullet and decided I to manually do the joining, and get a complete and clean dataset. Learning the lessons from past attempts at manual processing, it was a fairly smooth process. (Furthermore, things were significantly sped up by using Selenium - which allowed me to automate the process of searching for a movie on imdb). In the end, it took roughly 3 hours to tidy the dataset and have the official imdb id attached to each entry in my database. And now for the charts!

Year of release

Below are charts showing information about the year of release for the movies I have watched. The first one is just a histogram, and the second shows a scatter-chart showing the year I watched the movie against the year the movie released.

image image

Not sure if there is anything surprising about any of these charts. One neat thing is that one could probably get an idea of my age based on the first chart. The second chart seems to show that the majority of movies I watch are relatively new.

Ratings

Below is a chart showing the average ratings (by users of imdb) for the movies I have watched, along with the distribution of ratings for all the movies in imdb.

image

It is clear from this chart that I tend to watch ‘decent’ movies, as judged by imdb users, and that I avoid ‘bad’ movies, but I also seem to avoid the ‘best’ movies.

Below is a chart comparing the ratings for all the movies I have watched with the ratings of the movie I would recommend.

image

It is reassuring to see that, overall, the movies I recommend are generally better regarded than the movies I do not recommend.

Lastly, here is a chart showing the variation in ratings by the year I watched the movie.

image

I cannot really discern any patterns here, that aren’t revealed by other charts. Patterns that I can see are that I watched a lot more movies (and greater variety of quality of movies) in 2008 and 2009, and that the movies I recommend tend to have higher ratings than those I don’t.

To end this section, here is a list of the most and least popular movies I have watched.

Movie Rating on imdb
the shawshank redemption 9.3
the dark knight 9.0
12 angry men 8.9
the lord of the rings: the return of the king 8.9
pulp fiction 8.9
fight club 8.8
the lord of the rings: the fellowship of the ring 8.8
forrest gump 8.8
inception 8.8
the matrix 8.7
the lord of the rings: the two towers 8.7
goodfellas 8.7
star wars: episode v - the empire strikes back 8.7
se7en 8.6
city of god 8.6
interstellar 8.6
saving private ryan 8.6
the silence of the lambs 8.6
star wars: episode iv - a new hope 8.6
gladiator 8.5
the departed 8.5
casablanca 8.5
the usual suspects 8.5
dear zachary: a letter to a son about his father 8.5
whiplash 8.5
joker 8.5
psycho 8.5
senna 8.5
Movie Rating on imdb
steel 2.8
troll 2 2.9
the foreigner 3.4
batman & robin 3.7
half a person 3.8
friday the 13th part viii: jason takes manhattan 4.6
barely legal 4.7
elektra 4.7
doe: dead or alive 4.8
friday the 13th: a new beginning 4.8
uncut gem 4.8
blair witch 5.0
a teacher’s crime 5.0
tekken: the motion picture 5.3
in their skin 5.3
daredevil 5.3
scary movie 2 5.3
the circle 5.3
friday the 13th part vii: the new blood 5.3
little 5.4

The one thing I feel slightly ashamed of is that I watched so many of the Friday the 13th movies. I think my reasoning was that if a series has that many movies, there must be something good about it. I kept going on, even though I thought the movies were bad, in the hope that there is a moment in the series where the movies become good. I did finally stop watching the series - it just took eight movies to make that decision…

Genres

Below is a table showing a breakdown of the genres of movie I watched, ordered by which genre has the highest odds of me recommending it. Note that most movies had multiple genres.

Genre Frequency Frequency Recommended Percent recommended
thriller 126 37 0.29
war 14 4 0.29
sport 18 5 0.28
drama 319 87 0.27
sci-fi 86 22 0.26
crime 146 36 0.25
biography 47 11 0.23
music 18 4 0.22
romance 56 11 0.20
comedy 210 42 0.20
mystery 80 15 0.19
animation 51 8 0.16
family 25 4 0.16
history 26 4 0.15
fantasy 70 10 0.14
documentary 31 4 0.13
adventure 188 23 0.12
horror 66 7 0.11
action 227 23 0.10
musical 6 0 0.00
news 2 0 0.00
western 1 0 0.00

The entries that stand out to me are those with the largest frequencies. There is strong evidence that I am more likely to recommend a thriller or a drama than a comedy, and that I am unlikely to recommend adventure or action movies.

Directors

Below is a list of the directors, along with the movies, whose movies I have most watched.

Steven Spielberg
 a.i. artificial intelligence
          catch me if you can
                         jaws
                jurassic park
              minority report
      raiders of the lost ark
          saving private ryan
     the adventures of tintin

Peter Jackson
                                         king kong
                 the hobbit: an unexpected journey
         the hobbit: the battle of the five armies
 the lord of the rings: the fellowship of the ring
     the lord of the rings: the return of the king
             the lord of the rings: the two towers

Christopher Nolan
               dunkirk
             inception
          interstellar
               memento
       the dark knight
 the dark knight rises

Guy Ritchie
 lock, stock and two smoking barrels
                          rocknrolla
                     sherlock holmes
  sherlock holmes: a game of shadows
                              snatch
             the man from u.n.c.l.e.

Martin Scorsese
               cape fear
              goodfellas
                 silence
             taxi driver
            the departed
 the wolf of wall street

Quentin Tarantino
             inglourious basterds
                kill bill: vol. 1
 once upon a time... in hollywood
                     pulp fiction
                   reservoir dogs
                the hateful eight

Danny Boyle
    28 days later
       steve jobs
 t2 trainspotting
    trainspotting
        yesterday

Matthew Vaughn
                     kick-ass
 kingsman: the secret service
                   layer cake
                     stardust
           x-men: first class

David Fincher
                          fight club
                           gone girl
                               se7en
 the curious case of benjamin button
                  the social network

M. Night Shyamalan
             glass
 lady in the water
             split
   the sixth sense
       unbreakable

Darren Aronofsky
          black swan
             mother!
                noah
 requiem for a dream
        the wrestler

I tend not to pay any attention to who the director is, so for me, the interesting thing here is to see how movies that I would have said had no connection in fact have the same director. E.g. I did not realise I had watched that many movies by Spielberg. The other thing that stands out here is that all the directors are male.

Actors

Below is a list of actors, along with the movies, that I have most watched.

Brad Pitt
                    12 years a slave
                              allied
                  burn after reading
                          fight club
                inglourious basterds
                 killing them softly
                            megamind
                           moneyball
    once upon a time... in hollywood
                               se7en
                              snatch
                       the big short
 the curious case of benjamin button
                                troy
                         war machine

Bruce Willis
                 alpha dog
                  die hard
                die hard 2
              die hard 4.0
 die hard with a vengeance
          fast food nation
                     glass
                    looper
          moonrise kingdom
              pulp fiction
                  sin city
           the sixth sense
               unbreakable

Samuel L. Jackson
                    die hard with a vengeance
                                        glass
                                       jumper
                 kingsman: the secret service
                                 pulp fiction
 star wars: episode iii - revenge of the sith
                            the hateful eight
                       the hitman's bodyguard
                              the incredibles
                               the negotiator
                                  unbreakable
                                unicorn store

Matt Damon
          adjustment bureau
                  contagion
          good will hunting
               jason bourne
                      ponyo
        saving private ryan
        the bourne identity
       the bourne ultimatum
               the departed
 the legend of bagger vance
                the martian
    the talented mr. ripley

Tom Hanks
     angels & demons
 catch me if you can
        forrest gump
 saving private ryan
          the circle
           toy story
         toy story 2
 toy story of terror
     you've got mail

Robert De Niro
     analyze this
        cape fear
    dirty grandpa
       goodfellas
    hide and seek
            joker
 meet the parents
   righteous kill
      taxi driver

Rachel McAdams
                         about time
                              aloha
                     doctor strange
                         mean girls
                            red eye
                    sherlock holmes
 sherlock holmes: a game of shadows
                      state of play
                   wedding crashers

Natalie Portman
                                 annihilation
                                   black swan
                                       closer
    star wars: episode i - the phantom menace
 star wars: episode ii - attack of the clones
 star wars: episode iii - revenge of the sith
                        the other boleyn girl
                                         thor
                               v for vendetta

Leonardo DiCaprio
                    blood diamond
              catch me if you can
                        inception
 once upon a time... in hollywood
                     the departed
         the man in the iron mask
                     the revenant
          the wolf of wall street

Ben Affleck
                               argo
 batman v superman: dawn of justice
                          daredevil
                          gone girl
                  good will hunting
                           paycheck
                      state of play
                     the accountant

Jake Gyllenhaal
      donnie darko
           jarhead
      nightcrawler
 nocturnal animals
         prisoners
             proof
       source code
    velvet buzzsaw

Ian McKellen
                                          stardust
                 the hobbit: an unexpected journey
         the hobbit: the battle of the five armies
 the lord of the rings: the fellowship of the ring
     the lord of the rings: the return of the king
             the lord of the rings: the two towers
                                             x-men
                                  x2: x-men united

Christian Bale
          3:10 to yuma
       american psycho
        public enemies
  terminator salvation
         the big short
       the dark knight
 the dark knight rises
         the machinist

Morgan Freeman
      along came a spider
              deep impact
                     lucy
      million dollar baby
                    se7en
          the bucket list
 the shawshank redemption
                   wanted

Tom Cruise
          collateral
    edge of tomorrow
     minority report
 mission: impossible
            rain man
    the last samurai
            valkyrie
         vanilla sky

Johnny Depp
                   a nightmare on elm street
 fantastic beasts: the crimes of grindelwald
              fear and loathing in las vegas
     pirate of the caribbean: at world's end
  pirates of the caribbean: dead man's chest
                              public enemies
                                 the tourist

Ewan McGregor
                              angels & demons
                              black hawk down
    star wars: episode i - the phantom menace
 star wars: episode ii - attack of the clones
 star wars: episode iii - revenge of the sith
                             t2 trainspotting
                                trainspotting

Laurence Fishburne
 john wick: chapter 3 - parabellum
                        passengers
                         predators
                        the matrix
               the matrix reloaded
            the matrix revolutions
                        the signal

Robert Downey Jr.
             avengers: infinity war
                         iron man 2
                         iron man 3
                    sherlock holmes
 sherlock holmes: a game of shadows
             spider-man: homecoming
                       the avengers

Jude Law
       a.i. artificial intelligence
                             closer
                          contagion
                            gattaca
                    sherlock holmes
 sherlock holmes: a game of shadows
            the talented mr. ripley

Kevin Spacey
       a bug's life
    american beauty
        margin call
               moon
              se7en
     the negotiator
 the usual suspects

Orlando Bloom
                                       good doctor
           pirate of the caribbean: at world's end
        pirates of the caribbean: dead man's chest
 the lord of the rings: the fellowship of the ring
     the lord of the rings: the return of the king
             the lord of the rings: the two towers
                                              troy

Scarlett Johansson
                   her
           jojo rabbit
   lost in translation
                  lucy
        marriage story
          the avengers
 the other boleyn girl

Angelina Jolie
         alexander
 girl, interrupted
     kung fu panda
   kung fu panda 2
       the tourist
            wanted

Paul Giamatti
         duplicity
 lady in the water
      private life
          sideways
   the illusionist
           win win

Joaquin Phoenix
                  gladiator
                        her
               hotel rwanda
                      joker
                     quills
 you were never really here

Jim Carrey
            ace ventura: pet detective
                       dumb and dumber
 eternal sunshine of the spotless mind
                              the mask
                       the truman show
                               yes man

Anthony Hopkins
                alexander
                     noah
                    proof
               red dragon
 the silence of the lambs
                     thor

Tom Hardy
               dunkirk
            layer cake
                 locke
    mad max: fury road
 the dark knight rises
          the revenant

Keanu Reeves
                         john wick
              john wick: chapter 2
 john wick: chapter 3 - parabellum
                        the matrix
               the matrix reloaded
            the matrix revolutions

Emma Watson
                         beauty and the beast
 harry potter and the deathly hallows: part 1
          harry potter and the goblet of fire
       harry potter and the half-blood prince
                                         noah
                                   the circle

Clive Owen
     children of men
              closer
           duplicity
          inside man
            sin city
 the bourne identity

Ethan Hawke
               boyhood
               gattaca
           lord of war
        predestination
 the magnificent seven
             the purge

John Malkovich
     being john malkovich
       burn after reading
           johnny english
            ripley's game
 the man in the iron mask
              warm bodies

Elijah Wood
                                       deep impact
                                        happy feet
                                            maniac
 the lord of the rings: the fellowship of the ring
     the lord of the rings: the return of the king
             the lord of the rings: the two towers

Cameron Diaz
  being john malkovich
   shrek forever after
       shrek the third
              the mask
           vanilla sky
 what happens in vegas

Nice list of some of the more famous actors in the industry. One thing that surprised is how many movies I have watched that starred Brad Pitt - I did not realise it was that many! Once again, it is worth noting that females are under-represented here.

Conclusion

This project has probably been the one that I spent the most time on so far. I have learnt a whole bunch and managed to produce some nice visuals and summaries. Hopefully it was interesting to read!