Archive for
October 6th, 2008


Stories

Egypt: The Fire Series Continues

Apparently, the fire monster is not over with Egypt yet and has decided to shoot off to El Mehalla El Kobra. “Ghazl El Mehalla Textile Factories No. 6, 7, 16 have burnt down,” reports Arabawy.

Karim El Behiry reports from the Gharbeia governorate:

استطاعت قوات الدفاع المدنى بمحافظة الغربية من السيطرة على حريق هائل شب بثلاث مصانع لنسيج الهواء ” التكيفات الموجودة بمصانع نسيج الهواء ” نسيج 6 , 7 و 16 بشركة غزل المحلة صباح اليوم 4/10/2008 يذكر ان مصنع 6 و 16 متلاصقين ببعضهما اما مصنع 7 فبعيدا عنهم
“The civil defense unit in the Gharbeia governorate managed to control a huge fire that started this morning October 4, 2008, in three weaving factories; number 6, 7, & 16 of the Mehalla Textile Company.”

Karim continues:

كان عمال ثلاث مصانع نسيج الهواء ” التكيفيات الموجودة بمصانع نسيج الهواء ” بغزل المحلة قد فوجئوا صباح اليوم” السادسة صباحا ” عند دخولهم المصنع بنشوب حريق هائل تسبب فى تدمير عدد كبير من المكيفات وماكينات الهواء بالاضافة الى اقطان كانت معده للتصنيع وعلى الفور استغاثوا بقوات الدفاع المدنى التى حضرت وسيطرت بعد ثلاث ساعات على الحريق ولم يعلن رسميا عن الخسائر التى كبدها الحريق والتى متوقع ان تزيد عن 5 ملايين جنيها بالاضافة الى انه لم يصب اى عامل جراء الحريق
“The workers of the three factories were taken by surprise this morning upon their arrival at work at 6am when they saw that a fire has started and has destroyed a huge number of air-conditioners and other equipment, along with textile that was being prepared for manufacturing. They immediately called the civil defense units which arrived and managed to put down the fire after three hours. The losses have not yet been officially announced yet but it is expected to exceed 5 Million Egyptian Pounds, however, no human injuries or losses have been reported.

Back to Arabawy who notes the probable cause of the fire could be “electric sparks as the machines were re-started after the holidays. The textile factories of course are full of raw cotton supplies and inflammable materials. Fire spread quickly.”

The series of fires is really fishy, and a conspiracy theory is quite appealing for so many Egyptians, given the recurrence of the severe fires hitting influential/historic Egyptian buildings which started with the Egyptian Parliament on August 19th, 2008, followed by the National Theatre in Cairo.

Linuxawy lists the fires and tries to speculate which building's turn is it next?

He adds:

أنا مش باهزر والله انا مش مصدق ان كل ده صدف.. ممكن حاجات صدف وحاجات لأ، الحرايق ديه كلها فى أماكن سهلة الاشتعال خشب وورق وقطيفة والذى منه..كلها تقريبا ما فيهاش خسائر بشرية الا اعداد قليلة جدا وأغلبهم من المطافى..
“I am not kidding, I cannot believe it is all a matter coincidence.. Some might be coincidences, and others may not be. All the fires started in places where there was flammable material like wood, paper and fabrics…and all of them had minimal if no human loss except for a few firemen!!

Latin America: lore, ghosts, demons and frights.

Full moon
Full Moon by Irargerich
The mythology in Latin America is quite rich: some tales have been passed onto us from the Incas, Mayas or Aztecs, and others are colonial imports from Europe. On this first part of the multinational Latin American post, we'll visit some of the most popular myths and legends like the Llorona, the Cegua, the Cadejos and the Evil Light.

Legends and myths are part of our culture. Nina Maguid  mentions in her post “Of Fear and Frights”, that these stories were told in first person and usually around some source of fire, and I couldn't agree more. I used to hear local versions of some of these stories during my holidays, sitting around dining room tables at rural farmhouses, our faces lit up by a flickering kerosene lamp. All it took for a story to be recalled was the unexplained baying of dogs or a horse galloping by in the dead of the night.  Nina mentions three specific frights famous in her mother's Argentinean hometown: The bad light, the widow and the pig.

gaping maul
Scary creatures that jump at you by kevindoolay

According to Comodín at El Blog de Oro, this light would be used to hunt for treasure: if it was a white light, it would signal gold and silver treasure, if it was red, they had to run away, since it was the devil at work. This myths is by no means unique to Argentina: all over the world people have tried to explain the meaning of these mysterious lights which appear at twilight, like in Spain and Chile.

The Widow was a woman slighted in love, who died when she discovered her husband was unfaithful. She signed a deal with the devil to remain forever in this world and get her revenge. She would jump on single men's horses and ride pillion with them, and if they got frightened, she would kill them. The only way to remain unscathed was by carrying a rosary or crucifix and not getting scared. This myth is so fixed in Argentinean folklore that the expression “getting visited by the Widow” is a synonym for an unexpected or disagreeable event.

El Loco Bender (Crazy Bender) also writes about the Black Widow, and adds a bit more flair to the hair-raising story by promising a lonely, slow and painful death to those fickle or unfaithful men she meets.

Costa Rica has a similar myth, known as la Cegua. La Cegua will hitch a ride from lonely and unfaithful men, luring them with her attractive appearance, but once she is atop the horse, when the men look back they will see that her face is a horse's skull covered in putrid meat, and she will bite their cheek to mark them as unfaithful. However, blogger Elemental writes that the outcome may be far more dire: all unfaithful men die with their eyes wide open in fear, and those who weren't unfaithful keep their lives, but remain impotent for the rest of their lives.

Elemental also writes about the Cadejos, a demon dog that would appear at night with the sound of dragging chains, although none would be visible. The size of a small calf, this dog had matted hair, giant fangs and sizzling eyes, nose and ears, and would scare anything in its way, from naughty children and wayward men to farm animals. Nevertheless, this “fright” is considered benevolent, since it will walk along drunken men and make sure they get home safely, even protecting them from other beings of the night such as La Llorona or common thieves. In Guatemala, however, they consider that there are two versions of this dog: the black one and the white one. The white dog will protect anyone it walks with, and in Deguate.com, Mrs. Argentina Barcia tells of how the Cadejos led them to find her father's dead body.  At El Blog Chapin another goose-bump inducing story tells of how El Cadejos appeared to a city slicker staying at a homestead, and how people should take heed when warnings of the supernatural kind are delivered by country folk.

La Llorona next to a river
La Llorona by rareworlds

Our last legend for today is that of La Llorona, [en]  one that caused me to fear cats in heat for years and years of my childhood . La Llorona is “the crying woman, and this is one of the multinational frights. From Mexico to Chile, the Llorona stays near bodies of water (which might include a water tank in your garden) and wails for her missing children. She might just be there to scare you, or if you are in Colombia [es],  she might want you to hold her baby for just one second, since she's very tired, and then you'll be condemned to being La Llorona until someone takes the burden off your hands. The story of how her children went missing varies from one country to the other, but most have some of the same elements. Women who married men who were much richer than they were, got slighted or abandoned, and decided to take their anger out on their children by drowning them, to later regret their choice. Others versions have a young and flighty woman who leaves her baby out by a river rock where she things he'll be safe while she goes out dancing, and then the river rises and takes the baby away, and so the woman remains near rivers, asking everyone if they have seen her children.

The following Costa Rican animated short film, Asusto, by Pablo and Francisco Céspedes Jr showcases most, if not all the Costa Rican legends, including the ox-less cart and the headless priest. No translation necessary: there seems to be no need for words when you are busy running away from fright after fright.

Japan: Newsgraphy and HatenarMapsPhotos post

With ever-increasing amount of news information making its way onto the Internet every day, the question of how to parse and interpret this information is becoming more and more critical. Services such as Newsmap tackle this problem by visualizing data from news flows in a 2-dimensional space in an attempt to reveal patterns in news reporting.

Japanese blogger and engineer id:kaiseh [ja] has taken a somewhat different approach with their visualization tool HatenarMaps [ja], which made a splash [ja] in June of this year, and more recently with Newsgraphy, launched on September 25th. Both tools use Voronoi Treemaps to display data in a 2-dimensional space, HatenarMaps taking its information from Japan's popular blogging platform Hatena Diary [ja], Newsgraphy drawing in news feeds from Yahoo! News [ja]. id:kaiseh has also developed a popular [ja] visualization service for tracking the top bloggers on Hatena Diary through number of bookmarks and RSS readership, referred to as TopHatenar [ja].


Screenshot from HatenarMaps.

In a post from June 9th, id:kaiseh explains how HatenarMaps works:

このサービスを簡単に説明すると、はてなダイアリーのユーザに、獲得ブクマ数に応じた領土面積を割り当て、さらに似た者同士の領土を隣接させるという試みです。

To put it in simple terms, this service is an experiment in which regions [of a 2-dimensional map] are allocated to users of Hatena Diary according to the number of times they have been bookmarked, with regions of similar users placed next to each other.

地図の全体を見渡すことで、はてダの大まかなトレンドを掴むこともできるし、スケールを拡大していけば個別記事に到達することもできます。さらに、 Google Mapsで検索するような感覚ではてなidやキーワードを入力して地図を探索したり、「去年と今年で勢力図がどう変わったか」を調べることもできます。

Surveying the entire map enables [the user] to grasp broad trends in Hatena Diary, whereas by zooming in one arrives at individual blog entries. It's also possible to search the map by entering a Hatena id or keyword, similar to the way search works in Google Maps, and to compare differences in relationships of influence from year to year.

To get a good idea of how HatenarMaps works, have a look at the fantastic video below demonstrating the visualization algorithm. The video cannot be embedded directly, please see pages at Hatena (no registration) or NicoNico Douga (requires registration, English instructions for which can be found here) to watch it.:


Video from NicoNico Douga demonstrating visualization algorithm used in HatenarMaps. The video cannot be embedded directly, please see pages at Hatena (no registration) or NicoNico Douga (requires registration, English instructions for which can be found here) to watch it.

HatenarMaps is developed with Java, and uses the following method to minimize the group of all Hatena users to a manageable size:

まず、以下のルールに基づいて、はてなダイアラーの「上位1000人」を抽出します。

First, based on the following rules, the top 1000 users of Hatena Diary are selected out.

1. 被ブクマ数総計の多いユーザから順に抽出。
2. ただし、RSS購読者数が上位2000位以内にランクしていないユーザは除外。

1. Extract users with high bookmark totals in order [of number of bookmarks].
2. However, exclude users whose RSS readership numbers are not ranked in the top 2000.

(The blogger notes that the above steps use the database from TopHatenar.)

Next, vectors are calculated for each of these users:

次に、この1000人についてそれぞれ、被ブクマ数の多い日記エントリのベスト5までを対象に、はてブに付与されたタグの頻度を合計し、タームベクトルを構成します。ただし、タグは全部で数万個あるので、使用頻度の低いタグを切り捨てて、ベクトルの次元数を300まで減らします。

Next, a term vector is created for each of these 1000 Hatena users by summing together the frequency of tags assigned to the [user's] top 5 high-bookmarked diary entries in Hatena Bookmarks. However, since this would [add up to] tens of thousands of tags in total, low-frequency tags are dropped, decreasing the dimensionality of the vector to 300.

And finally, groups are created through clustering:

各ユーザに対してベクトルが定まったら、そのベクトルを基に、K-means法という手法による非階層的クラスタリングを実行して、1000人のユーザを100個のクラスタに分割します。この結果、はてブタグの類似性が強い(≒日記のテーマが似ている)ユーザ同士がグループを形成します。

Once the vector has settled [to fixed values] for each of the users, non-configurational clustering using the K-means technique is performed, dividing the 1000 users into 100 clusters. As a consequence, users which have strong similarities in their Hatena Bookmark tags (i.e. whose diaries have similar themes) are grouped together.

このときついでに、グループに名前を付けます。グループに属する全ユーザのタームベクトルを合計し、一番強い成分のタグをグループ名とします。

At this time, groups are attached names. Term vectors of all users belonging to the group are summed together, and the tag with the strongest representation is adopted as the name of the group.

For further details about how HatenarMaps works, please see the original post in Japanese.


Map of news by subject using Newsgraphy

Newsgraphy is a service with a similar concept to that of HatenarMaps. In a September 25th post, id:kaiseh explains:

6月に公開して大きな反響をいただいたHatenarMapsの可視化手法を、Yahoo!のトピックスAPIから取得したニュース記事に適用して、いろいろと機能強化を施したものがNewsgraphyです。Mashup Award 4thにも応募しています。

Newsgraphy applies the visualization technique from HatenarMaps, which drew a big response when it was made public in June, to news articles obtained from the Yahoo! Topics API, with various functional enhancements. I've also submitted it to Mashup Award 4th [see site in English].

追記(2008/9/26): 「HatenarMapsの可視化手法を適用」と書きましたが、これは二次元平面へのマッピング手法(Voronoi Treemap)のことで、クラスタリング手法は含んでいません。Newsgraphyは、Yahoo!で分類済みのニュースカテゴリ階層を使用しています。

Note (2008/9/26) : When I wrote that [Newsgraphy] “applies the visualization technique from HatenarMaps”, I meant the technique for mapping to a two-dimensional surface (Voronoi Treemap), and not the clustering technique. Newsgraphy makes use of news category layers pre-classified by Yahoo!

The blogger then contrasts Newsgraphy with newsmap:

ニュースの可視化と言えばnewsmapが有名ですが、newsmapよりも面白くて実用性の高いサイトを目指して開発しました。

Newsmap is well-known in the area of news visualization, but what I was aiming in developing [Newsgraphy] was a site that is more interesting and more practically useful than newsmap.

and with HatenarMaps:

HatenarMapsでは各々の領土が角ばっていて、地図というにはやや無機的な感じがしていたので、地形をフラクタル化してみました。かなり自然物に近い見た目になったと思います。

In HatenarMaps, each region is very angular, and I had the feeling that as a map it was somewhat inorganic, so [with Newsgraphy] I made the topography more fractal-like. I think it has an appearance that is very nature-like.

In Newsgraphy, it is possible to narrow the range of visualization through use of a calendar:

カレンダーで日付の範囲を指定すると、その期間内に報道されたニュースの領土がハイライトされます。この機能を使えば、世間で注目されているトピックが時系列的に推移する様子を観察できます。

When you specify a range of dates using the calandar, regions are highlighted corresponding to news that was reported during that period. This function makes it possible to observe transitions, in chronological order, between high-profile topics.


Visualization of news in a specific time range (white regions) using Newsgraphy. The grey region is labeled “LDP elections”, and the white regions are news stories on September 22nd on this topic.

id:kaiseh notes later that it is possible to highlight regions by searching for keywords. The default mode colors regions differently according to the category of news, with a 3-color classification scheme used to enable users to survey news from various perspectives.

There is another visualization mode for person/place/organization, which functions as follows:

ニュースの見出しを形態素解析した結果から

From results of a morphological analysis of the news headline:

* 特定の人物に関わるニュース
* 特定の(地理的な)場所に関わるニュース
* 特定の企業や組織に関わるニュース

* News involving specific persons
* News involving specific (geographic) places
* News involving specific companies or organizations

を判別し、それぞれアイコンで表示します。緑が人、青が場所、赤が組織のアイコンです。

are separated, and each is represented as icons. Green icons for people, blue icons for places, and red icons for organizations.


Visualization in Newsgraphy by person (green) / place (blue) / company or organization (red)


Region for news about marriages and divorces of famous entertainers, mostly green because it is news about people.

Finally, news can also be categorized by coloring it according to how recent it is. In this method:

最近のニュースほど緑豊かな領土になり、古いニュースほど土気が多い領土になります。

The color of regions corresponds to when the news came out: regions for recent news items are colored a verdant green, whereas older news items are colored an earthy brown.


News about the recent tainted rice scandal, visualized by how recent news items are. The scandal was covered most heavily a few weeks ago, so most news items are brown (old) and not green (new).

The blogger finishes the post with a look to the future of Newsgraphy:

クローリングは今月9日から開始しているので、まだ情報が若いですが、今後半年、1年とデータが溜って地図が成長すれば、かなり面白いニュース傾向分析ができるようになると思います。

Crawling only started from September, so it only includes recent information, but I think that in the next half-year or year, as data is collected and the map develops, it will become possible to do really interesting analysis of news trends.