As of today, no one knows how to translate paintings, flowers or music into language. Their beauty is implicit and exclusive to their form, which is why it's so hard to explain how a particular piece of art makes us feel.
⠀
nothing is original. steal from anywhere that resonates and fuels imagination.
old films, new films, music, books, paintings, photographs, poems, dreams, architecture, conversations, bridges, street signs, trees and clouds, bodies of water, light and shadows.
only streal things that speak directly to your soul and your work (and theft) will be authentic. originality is non-existent, authenticity is invaluable.
it's not where you take things from-it's where you take them to.
⠀
in the end, stories are about one person saying to another: this is the way it feels to me. can you understand what i'm saying? does it feel this way to you too?
⠀
crowd exists as long as it has an unattained goal.
⠀
the idea becomes a machine that makes the art
⠀
⠀
works under writing are original, my notes a mix of thoughts with quotes from the artwork subject of the note. about · contact
⠀
⠀
⠀⠀
books
⠀⠀
articles
⠀⠀
film
⠀
philo
⠀
⠀ ⠀
⠀ ⠀
writing keeps ideas in space
speech lets them travel in time
we use paintings to decorate space
and music to decorate time
⠀ ⠀
⠀ ⠀
find the way by moonlight
see the dawn before
the rest of the world
⠀ ⠀
⠀ ⠀
unconscious time, no peace of mind,
falling in space but still alive.
sketching the future in a single line,
everything's spinning, cannot sit down.
moments in space, places in time,
thoughts penciled in, now come to life.
⠀ ⠀
⠀ ⠀
As of today, no one knows how to translate paintings, flowers or music into language. Their beauty is implicit and exclusive to their form, which is why it's so hard to explain how a particular piece of art makes us feel.
⠀ ⠀
⠀ ⠀
⠀⠀
⠀
⠀
symbols
⠀
⠀
⠀
⠀
this is a collection of notes that i've written over time, mostly for myself. in the spirit of working with garage doors open, i've published them and open sourced this website.
⠀
⠀
⠀⠀
⠀⠀
⠀
text-to-image models are not creative but derivative. they use data from countless artworks, sometimes without the author's consent, to create new and original results.
the rise of photography in the 1850s is a good example.
until then, painters were judged by their ability to accurately represent reality. they felt threatened since anyone with a camera could now do their job.
⠀
⠀ ⠀
Usage of AI tools skyrocketed on launch and their impact is being felt in many fields, from financial accounting to psychologist's offices and creative studios. Image generation with AI has also evolved in a short time to a point of near-perfect photorealism and some artificial images have already gone viral worldwide.
⠀
AI models are not creative but derivative, meaning they use elements and styles of countless artworks and paintings, sometimes without their creator's consent, to create new and original results. This mechanism is particularly responsible for negative reactions and debates around copyright, misinformation and the ethical implications of artificial intelligence in the creative process.
⠀
Just recently on April 14, TikTok user Ghostwriter977 released "Heart on My Sleeve", a song that used AI to mimic the voices of singers Drake and The Weekend, without neither singer being involved in the process. Just 3 days later, their record label, Universal Music, condemned the use of AI to create the song, invoked copyright violation to take down the track, and asked streaming platforms to block AI companies from accessing their songs. The 2-minute-14-second song had already been listened to over 20 million times by then.
⠀
Not all reactions have been negative: the Japanese government became the first one to settle that they won't enforce copyright on artworks used for AI training and British singer Paul McCartney recently announced that the 'last Beatles song' will be completed using AI and released in 2023. The use and progress of these tools will only increase, soon disrupting all areas of artistic creation, from music and painting to photography and cinema. And while Record labels and Studios are currently hostile towards AI, I believe they'll embrace it as soon as they start to profit from it. (Maybe dead artists and actors will be revived to make new songs and movies with current artists, Bad Bunny+Freddie Mercury?)
⠀
⠀
But even if it seems we might be entering an new era of media creation that is hostile to artists, this is not the first time technology has disrupted art. The birth and rise of Photography in the 1850s enabled a mass reproduction of art which allowed paintings and sculptures to be seen my multitudes of people, while simultaneously degrading their individual influence and impact.
⠀
Artists who made a living making portraits of people or vedutas (hyper-realistic paintings of cities, often souvenirs for tourists) felt threatened since photography could capture reality instantly and with more accuracy than them. The jobs they had for centuries could now be done by anyone with a camera. Privacy and copyright concerns became a heated issue as well: if people can photograph others without their consent, who owns the photo? Photographer or photographed?
⠀
If photography is allowed to replace art in some of its functions, it will soon have supplanted or corrupted it completely, thanks to the natural alliance it will find in the stupidity of the multitude.
– Charles Baudelaire, Salon de 1859
⠀
Until then, painters and their art were usually judged by their ability to accurately represent reality. As photography became more adopted and accepted as a new form of art, it suddenly reduced these expectations. Artists were now free to explore and pursue their own interests, passions and ideas without needing to worry about visual accuracy. Modernists movements like Impressionism, Cubism, Surrealism and Abstract Art soon followed, and painting had its biggest revolution, both visually and philosophically.
⠀
⠀
Photography kept evolving and eventually allowed for the birth of an even more powerful art form to arrive, cinema. Although AI technologies are still in their infancy and limited to image generation, the arrival of text-to-video models is imminent and could challenge Cinema just like photography did to art. Current models already show an impressive understanding of cinematic language and it won't be long until anyone is able to create a photorealistic movie by simply writing a script and describing the rest of the movie using natural language. Users will be able to specify cameras, lenses and framings and AI models will create photorealistic sets, props, actors and dialogue that match the user's intentions.
⠀
Without the need for physical locations, crews or large budgets, the cost of making movies will be significantly reduced, allowing for a democratization of the Hollywood Film Studio that will open the door for new voices previously limited by the cost of filmmaking.
⠀
Images from these movies might not be human but knowledge behind them certainly will be. Human creativity will then ultimately determine how meaningful AI-aided cinema is: ideas and stories explored will need to be powerful to allow them to travel through minds and eventually become culture.
⠀
⠀
As of today, no one knows how to translate paintings, flowers or music into language. Their beauty is implicit and exclusive to their form, which is why it's so hard to explain how a particular piece of art makes us feel.
⠀
Traditional Cinema will always exist, but as progress in AI image and video generation continues, I believe a new epoch of cinema will emerge where anyone will be able to make a movie using natural language. For the first time, film and text will become the same thing: anyone will be able to read, write or watch a movie and every frame will be generated, not filmed.
⠀
This new Synthetic Cinema will allow movies to detach from the camera, empowering filmmakers to break free from the limits of traditional cinema and pioneer new visual styles, just like impressionists did when they created a new visual style by removing physical influence from painting a century ago.
These movies won't be better or worse, they'll just be different.
If photography is allowed to replace art in some of its functions, it will soon have supplanted or corrupted it completely, thanks to the natural alliance it will find in the stupidity of the multitude.
As of today, no one knows how to translate paintings, flowers or music into language. Their beauty is implicit and exclusive to their form, which is why it's so hard to explain how a particular piece of art makes us feel.
⠀
⠀
notes on david deutsch's (fascinating) the beginning of infinity (2011), about infinity & universality, memetics and philosophy of science.
⠀ ⠀
⠀ ⠀
curiosity: thinking existing explanations don't fully capture the ideas behind them, being unsatisfied with current stories.
⠀ ⠀
creativity: ability to create and replicate ideas to increase the amount of usable knowledge.
⠀ ⠀
ideas: information that can be stored in human brains and affects behaviour.
⠀ ⠀
culture: set of ideas that cause holders to behave alike.
⠀ ⠀
some aspects of nature (night sky, waterfalls, sunsets) seem to be beautiful to humans but show no signs of being designed with this intention. However, flowers do seem to have an apparent design for beauty.
humans recognizing that flowers are beautiful even though they evolved this way for unrelated purposes is evidence that some beauty is objective: it can be found in all places from the flower's genome to human minds.
⠀
⠀ ⠀
enlightenment: 1688 (English Enlightenment), inconceivable a century earlier.
static societies: people could expect to die under the same values, lifestyles, technology and patterns of economic production.
humans alone are authors of explanatory knowledge, the human behaviour called history.
⠀ ⠀
nature of science can be understood with theories=misconceptions
scientific method: increasingly difficult to ignore philosophical implications of the fact that nature had been understood in unprecedented depth, and of the methods of science and reason by which it was done.
evolution: optimizes neither good of species or individual, but the relative ability of surviving variants to spread through population. it favours only genes that spread best.
genetic code as language for organisms has shown phenomenal reach.
evolution of biological adaptations and creation of human knowledge are similar (ideas and genes are replicators, knowledge and adaptation hard to vary) yet distinct (human knowledge as explanatory and with reach, contrary to adaptations.)
⠀ ⠀
quantum physics
quantum theory discovered independently by Heisenberg and Schrödinger between 1935 and 1927.
issue: not consistent when applied to the case of an observer performing quantum measurements on another observer.
⠀ ⠀
computational universality should have happened with Babbage's Difference Engine (1820s), which had rules of arithmetic built into hardware to to automate log, cos, sin (used in navigation and engineering).
193# electrical relays for the analytical engine were just being used for the first applications of electromagnetism and were about to be mass produced for the telegraphy revolution.
Turing Test: The general-purpose sense of Intelligence that Turing meant (constellation of attributes of the human mind) puzzled philosophers for a millennia. (others are consciousness, free will and meaning).
Quantum computation: Computation in which the flow of information is not confined to a single history.
Paul Feyder, French first assistant on the film [To Catch a Thief], presented me to Hitchcock. Our conversation lasted fifty or sixty minutes (there were retakes) during which time Hitchcock did no more than throw one or two quick glances at what was going on.
⠀
Michel Foucault, 1967-1971
⠀
Il fait jouer les propriétés spatiales de la toile (matérielles, superficie, hauteur et largeur) dans ce qu'il représentât dans cette toile
La musique aux Tuileries, 1862
Le bal masque a l'Opera, 1873
: 10 ans après, mêmes personages avec équilibre spatial differentL'execution de Maximilien, 1867
Le port de Bordeaux, 1871
Argenteuil, 1874
Dans la serre, 1879
La serveuse de bocks, 1879
et Le chemin de fer, 1872-1873
⠀
Usage d'une lumière extérieur réelle qui remplace un faux éclairage de l'intérieur du tableau.
Le Fifre, 1886
Olympia, 1863
Le Balcon, 1869-1869
⠀
Seulement une des dernières et plus bouleversantes toiles de Manet est étudiée pour résumer toute son œuvre: Un bar aux Folies-Bergere.
Un bar aux Folies-Bergere, 1881-1882
⠀
Manet est le premier dans l'art occidental (au moins depuis la Renaissance) à faire jouer les propriétés matières de l'espace sur lequel il peignait, à l'intérieur des tableaux et de ce qu'ils représentent. Il modifie les techniques et modes de representation picturale (qualités et limitations matérielles de la toile que la tradition picturale avait jusqu'à la eu pour mission d'esquiver ou masquer) et rends possible le movement impressionniste et toute la peinture qui allait venir après. Manet n'invente pas la peinture non-représentative mais la peinture-objet dans ses éléments matériels.
Manet est le premier dans l'art occidental (au moins depuis la Renaissance) à faire jouer les propriétés matières de l'espace sur lequel il peignait, à l'intérieur des tableaux et de ce qu'ils représentent. Il modifie les techniques et modes de representation picturale (qualités et limitations matérielles de la toile que la tradition picturale avait jusqu'à la eu pour mission d'esquiver ou masquer) et rends possible le movement impressionniste et toute la peinture qui allait venir après. Manet n'invente pas la peinture non-représentative mais la peinture-objet dans ses éléments matériels.
⠀
DVDs' disappearance → films mainly profit from ticket sales
Streaming now an accessible alternative, but profits = time spent on service
internet speed and phone camera improvements → global increase in social media's influence
≈ 2014: platforms shifted to algorithm-based content presentation → birth of viralization.
⠀
⠀
⠀
Recent trends describe the current state of cinema as fragile and in decline. Industry figures have expressed this opinion, notably Martin Scorsese who in 2019 wrote an essay arguing that "the situation at this moment is brutal and inhospitable to art." Many of these statements blame franchise films and the modern way of producing them as the main drivers behind cinema becoming increasingly homogeneous and formatted, resulting in a market saturated with movies that look and feel the same. ⠀
Studios today have the option to release a movie in cinemas, but since the disappearance of DVDs, movies have lost most of their ability to make money after leaving theaters. Revenue now comes almost entirely from the number of tickets sold, which means that maximizing profits now means maximizing audiences. A movie is more accessible across cultures if it has a simple style, an easy-to-follow plot and few cultural or ideological references. This explains why many studios now consider following a repetitive (but successful) formula as more important when making a movie than the individual creative talent behind it.
Streaming releases have become an alternative to theatrical ones now that every major studio has launched its own platform. This is not always a bad option since it allows smaller movies and filmmakers to instantly reach an audience of millions without having to worry about selling tickets. But streaming platforms need users to consume as much content as possible to be profitable, and since hours spent on the service justify subscription prices, many of their productions are designed to be consumed passively, while users cook, clean, or browse their phone. These movies are not cinematic experiences but rather ambient ones, where results are "as negligible as they are interesting," as Brian Eno wrote when defining ambient music in 1978.
These two recent tendencies have helped studios and the film industry grow, but sequels, remakes, and movies based on existing material now capture most of Cinema's profits. Only 3 of the top 50 highest-grossing worldwide films of the 2010s were original stories.¹ Additionally, "good" (or at least recognized) Cinema is still struggling. The Oscars, arguably still today's biggest event and celebration of popular cinema, have seen their viewership steadily decline for decades. 55 million people watched the awards in 1998, compared to 41 million people in 2010 and just 10 million in 2021. Recent Academy Award winners have also grossed less money as time goes by. The combined Best Picture winners from the 1990s made around $5 billion worldwide, while combined winners of the 2000s made $3.4 billion and those of the 2010s, $2 billion.
This is the main idea behind recent statements and opinions on cinema: While globalization has strengthened the film industry, movies have lost economic and cultural influence. Cinema now risks not being the most popular form of storytelling in the 21st century, and newer forms of artistic expression could take its place.
⠀
⠀
Even if the modern way of making movies is partly responsible, it would seem that new consumption patterns are also at the heart of this situation. Internet speeds started to increase globally in the early 2010s and the primary way people express themselves online evolved from text and photos to eventually, video. As phone cameras got better, photo-sharing services like Instagram started pushing ordinary people to take and share pictures, not only professional photographers. Snapchat pushed this even further by making the camera, not content, be the first thing users see when opening the app.
A collective of ordinary people became the main authors of mass amounts of content and media that started to be uploaded, shared, and consumed online. Social media companies soon needed to show posts based on popularity to keep users longer on their apps and make their platforms more attractive. This began in 2009 with the introduction of likes and retweets as tools for finding the most engaging posts, but rapidly escalated. By 2014, most social media platforms showed content based on their engagement, not in chronological order. This marked the first time that algorithms chose what people saw and the beginning of viralization, which allowed content from anyone on earth to reach an audience of millions (now billions) of people.
Recent companies like TikTok have thrived by taking these new dynamics even further. Since the only way to browse content is by swiping up or down, TikTok's algorithm can learn about users' interests with every single interaction they make –if something's not interesting, the user will swipe quicker. Combined with its near-infinite supply of videos from all cultures and languages, only a couple of minutes are needed to learn and personalize content for anyone on earth. Since algorithms are also set as the main referees of what people see, TikTok helps people go viral without the need for network effects. Any user can reach millions of views without fame, status, followers, or even friends on the app. The implementation of these dynamics into the design and mechanics of the app is partly responsible for TikTok's huge success. The company seems to also understand their impact, stating in April 2022 that they didn't see themselves as a social media platform, but rather an "entertainment company."
⠀
Cinema then found itself in the middle of this new changing world, but failed to adapt. It soon started to be consumed like every other form of online media, getting transformed in the way: as movies became available anytime and could be paused, they lost some of Cinema's continuousness. Since movies also became available anywhere, people started watching them alone or with few others, which broke Cinema's locality and collectiveness. And as phones and computer screens become the primary ones for most people, Cinema lost the big screen.
This is where Cinema lost its grandeur and got transformed into simple content. Without these qualities, movies risk not being the primary storytelling vehicle for the 21st century. But I don't think this means cinema is dying, but rather that it is evolving. There is an old saying that "the first 50 years of the car industry were about creating and selling cars, but the second 50 years were about what happened once everyone had a car." After a majority of people owned one, they transformed businesses, suburbs, cities, people, and culture. Access to the internet is on track to become a human right, and the number of smartphone users is rising rapidly, with 83% of the world population owning one in 2022 (!).
As these technologies become universal like cars before them and algorithms determine more and more of popular culture, it seems like we're entering a democratization of media creation that allows anyone's voice to reach a global audience. But content chosen by algorithms only represents the average of everyone's tastes and interests. This is where filmmakers have the opportunity to think about how they could play with these new formats and adapt the cinematic experience. To do so, Cinema might need to move away from some of its traditional characteristics and embrace other new dynamics.
⠀
In this sense, TikTok's success could mean that short-form portrait video is an initial evolution and answer to the question "what happens to Cinema when everyone has a phone and Internet?" But as movies, technology, and people keep changing, short-form video might evolve even more and resemble Cinema even less. At that point, will it still be cinema, or something new? What comes after cinema?
⠀
⠀
¹ Frozen (2013), Zootopia (2016), Secret Life of Pets (2016).
⠀
⠀
numbers were the first writing system to exist. it started with the same symbol being used for all numbers: IIIIIIIIIIIII
IIIIIIIIIIIII → IIII IIII III
⠀
the best example of this new kind of writing systems are Roman numerals. they used 7 symbols (I, V, X, L, C, D, M) and 3 main rules:
VI+VII → VIVII → VVIII
VVIII = 5+5+1+1+1
VVIII → VV=X → XIII
⠀
the biggest leap Roman numerals made was allowing people to manipulate numbers without needing to count each symbol individually: their design implicitly teaches people how to do math.
MMMMMCDII + MMMMMMMCCDIII
⠀
Hindu-Arabic numerals were invented in 9th century India but only became commonly used until the 1500s.
002=2 ⠀ 020=20 ⠀ 200=200
⠀
every numeral system incorporates certain knowledge about which relationships of numbers are the most interesting to use.
∴ design and mathematical insights work together:
⠀
Roman numerals allowed new ideas and uses of numbers like salaries, taxes and interest rates to spread, but their design also deeply limited scientific progress.
⤷ no major abstract mathematical discovery was made during the ~2400 years they were in use.
Conceptual art is good only when the idea is good.
⠀
conceptual art: idea or concept as the most important aspect of the work.
the idea becomes a machine that makes the art.
The form itself is of very limited importance; it becomes the grammar for the total work. arrangement becomes the end while the form becomes the means.
Space can be thought of as the area occupied by volume, where the question would be what size is best. If artwork is gigantic its size alone would be impressive and the idea may be lost. if it's too small, it may become inconsequential.
⠀
the idea becomes a machine that makes the art.
notes on Paul Graham's ideas on taste, beauty and design from some of his essays.
All of us had been trained by Kelly Johnson and believed fanatically in his insistence that an airplane that looked beautiful would fly the same way.
⠀
⠀
⠀
In the past 20 years, as we all know, the movie business has changed on all fronts. But the most ominous change has happened stealthily and under cover of night: the gradual but steady elimination of risk.
I fear that the financial dominance of one is being used to marginalize and even belittle the existence of the other.