Setting Up Your Own Jython 2.5.1 Environment

In this post I’ll show you how to setup your own Jython environment.

Prerequisite to this, you must have a Java Runtime Environment (JRE) installed in your system. Chances are when you already have browser running some Java applet or Java Web Start application, you already have JRE installed on your system.
Get the latest JRE from http://java.com/en/download/manual.jsp.

First you need to download a Jython binaries installer, currently the latest one is version 2.5.1, which you could download from this link.

After download completion you should have a file named jython_installer-2.5.1.jar, click on the file, or run from command line:

$ java -jar jython_installer-2.5.1.jar

Or in some other platform:

c:\> java -jar jython_installer-2.5.1.jar

Now you need to add you Jython path to your OS Path variable, so that the shell or command line interpreter is able to find Jython. In my sample Windows installation case:

C:\> set PATH=%PATH%;c:\opt\env\jython2.5.1

Alternatively, if you are running bash shell (assuming you installed Jython to /opt/env/jython2.5.1 folder):

$ export PATH=$PATH:/opt/env/jython2.5.1

Now you may proceed with the first invocation of Jython.

C:\> jython
*sys-package-mgr*: processing new jar, 'C:\opt\env\jython2.5.1\jython.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\resources.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\rt.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\jsse.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\jce.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\charsets.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\ext\dnsns.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\ext\localedata.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\ext\QTJava.zip'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\ext\sunjce_provider.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\ext\sunmscapi.jar'
*sys-package-mgr*: processing new jar, 'C:\Program Files\Java\jre6\lib\ext\sunpkcs11.jar'
Jython 2.5.1 (Release_2_5_1:6813, Sep 26 2009, 13:47:54)
[Java HotSpot(TM) Client VM (Sun Microsystems Inc.)] on java1.6.0_16
Type "help", "copyright", "credits" or "license" for more information.
>>>

The jython command line actually invoked a Windows batch file jython.bat, which
When first time invoked, Jython interpreter will activate sys-package-mgr to add standard Java library classes as Python package.

After the installation, just play around with simple thing such as:

Jython 2.5.1 (Release_2_5_1:6813, Sep 26 2009, 13:47:54)
[Java HotSpot(TM) Client VM (Sun Microsystems Inc.)] on java1.6.0_16
Type "help", "copyright", "credits" or "license" for more information.
>>> from java.lang import System
>>> System.out.println("Hello, world!")
Hello, world!
>>> System.out.println('Hello, world!')
Hello, world!
>>> System.currentTimeMillis()
1257145977410L
>>> from java.lang import String
>>> s = String("abc")
>>> s.toString()
u'abc'

Look at how System.out.println is able to receive both single quote and double quote Python string, and also the java.lang.String type by a Java class method is a Unicode string (u’abc’).

PyDev 1.5 on Eclipse Galileo 3.5 SR1

I begin to have more time to explore the Eclipse Galileo Service Release 1 (Eclipse 3.5.1). This time I want to set it up for my Python development, using the PyDev plugin.

PyDev is an Eclipse plugin for Python language application development. It supports CPython, Jython and IronPython runtimes. It supports the interactive as well as non-interactive Python development on Eclipse IDE.

Eclipse IDE (and platform) has become the de facto industry standard IDE. More and more free software, open source software, and proprietary software makers build their systems on Eclipse platform. Galileo is the codename for 3.5 release, and now the latest one is the SR1 (Service Release 1).

There has been interesting development on PyDev since its last 1.4.7 version. PyDev has moved to be sheltered under the umbrella of Aptana. PyDev and PyDev Extension now has been merged and both now open source (previously the PyDev Extension, the advanced version of PyDev was not an open source).

The update site has been moved from domain www.fabioz.com (http://www.fabioz.com/pydev) to domain pydev.org (http://pydev.org/updates) . Aptana  This development looks good for me, means that PyDev now being maintained by its own organization, and hopefully in more serious efforts.

In Eclipse Galileo, you need to go to the menu and choose: Help > Install New Software…

It will show the Install dialog.

Click the [Add] button on the upper of menu dialog. You will get the “Add Site” dialog.

Type name and location.
Name: “PyDev Update  Site” (you can feel with any arbitrary name though)
Location: http://pydev.org/updates

Back to the “Install” dialog, the previous “Add Site” will fill up the “Work with” field for you.

Now tick the Checkbox “PyDev for Eclipse” under “PyDev”. You may also optionally tick the “Pydev Mylyn Integration”. In this example we don’t tick.

Click the [Next >] button. It will show you the Install Details:

Proceed by clicking [Next >] button. Review Licenses dialog will be displayed.

Click the radio button “I accept the terms of the license  agreement” when you are agree with the licenses. Proceed by clicking [Finish] button.

You will see the progress bar. Somewhere around the progress, you will be asked whether to install software that contains unsigned content.

Click [OK] to proceed (we have no choice as long as the provider of this plugin hasn’t signed the content).

Click the [Yes] button to restart your Eclipse IDE.

Chardet Python Library: Determining Character Encoding of Text File or Text Stream

Recently I have came into a disagreement with fellow programmer. He tried to create view simple codes in different programming languageshe knows: C, C++, Perl, Python, PHP, and Java (I think it’s for self-actualization, obviously not for money or wealth). It turns out to be he created XML parser codes on those (programming) languages.

The code doesn’t produce as expected, except of course in Python. He ascertained that it is because most those languages make use of libxml2 library (from GNU). He came into a conclusion that the Java library might also make use of the libxml2 library from GNU, which I believe most unlikely. Java wouldn’t normally pick GNU stuffs for its library. It really hit into my Java developer pride, and I need to prove that it is not the library that is incorrect, instead the input file is not correctly encoded.

Although in Western world most text files usually play along well most of the time, characters other than ordinary characters will be displayed incorrectly. Most of the case it will be displayed incorrectly in countries that uses special characters!

Since the first time I work in Singapore, I absorb it quickly that the ability to display these special characters are one important thing a web application should have, especially when they cater for the Asian market! You will see that they will require you to do i18n, display this in Traditional Chinese characters, in Simplified Chinese characters, Tamil characters, Thai characters, to name a few…

It brought me to this question:
If I have an arbitrary text file, how could I know which encoding the text uses?

I googled around and found  this: Universal Encoding Detector (chardet) library. The chardet site shows how to do it for web sites.

>>> import urllib
>>> urlread = lambda url: urllib.urlopen(url).read()
>>> import chardet
>>> chardet.detect(urlread("http://google.cn/"))
{'encoding': 'GB2312', 'confidence': 0.99}

>>> chardet.detect(urlread("http://yahoo.co.jp/"))
{'encoding': 'EUC-JP', 'confidence': 0.99}

Now it here comes the next question for me: if it is not a web site, but a file instead, how to detect the encoding?

So here is the solution:

>>> import chardet
>>> fileread = lambda filename: open(filename, "r").read()
>>> chardet.detect(fileread("italian-english.xml"))
{'confidence': 0.9899999999999999, 'encoding': 'utf-8'}

>>> chardet.detect(fileread("utf8_demo.txt"))
{'confidence': 0.9899999999999999, 'encoding': 'utf-8'}

So this way, I checked that the text file is most likely an UTF-8 encoded text.

By the way, the encoding detection engine library was derived from (or ported from) Mozilla auto-detection code, which has been widely used. So more or less I believe it is mature and powerful enough for most usages.

Another thing to note is that those codes above are using lambda notation, a feature of Python language borrowed from pure functional programming syntax.

Simple Swing Application on Jython 2.5

I need to create a prototype GUI user interface in Java Swing. In order to make it faster I decided to create it on Jython. I have been using Java classes from Jython for quite sometimes, but I have never tried to create a Python-style implementation of certain Java interface.
In this part I will explain first how it works when using Java Swing objects from Jython.
The next part will deal with the implementation of Java interface.

In Jython, it’s very easy to create a Java Swing window.
This is an example:

from javax.swing import JFrame
mainFrame = JFrame("Hasta la vista, Baby!")
mainFrame.show()

On my Vista machine, it will display a small window that looks like this:

Ok. It is understood that we need to adjust the size of the frame so that i won’t look so ugly.

from javax.swing import JFrame
mainFrame = JFrame("Hasta la vista, Baby!")
mainFrame.setSize(400,300)
mainFrame.show()

That code should do the trick.

Ok. Now things to note on this code:

• When it comes to JFrame or Window in Swing, closing the window doesn’t mean that the object is no longer there.
• The window will only be disposed when you invoke the dispose() method.

Click the close button on the Swing frame/window or Alt-F4
Let’s what happens when while in the same Jython session, we type this:

mainFrame.show()

It will still show the window.

Try some more tricks, after closing the frame/window, type these into your Jython console session:

mainFrame.setSize(300,400)
mainFrame.setTitle("Buenos tardes, Mis Amigos!")
mainFrame.show()

.

Merge of Redundant Methods in Python 3.x

Python 3.x suppose to have a more structure structure and avoid redundant methods.
This is an example on how a redundant string manipulation/query methods were eliminated and only one preserved (only on str, removed from string library).

I tried this code section:

import string

string.find("abcdijfHOWDYckfj", "HOWDY")

Result:

7

While when running it on Python 3.1:

import string

string.find("abcdijfHOWDYckfj", "HOWDY")

The interpreter throws this error:

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

AttributeError: 'module' object has no attribute 'find'

I found out through the documentation that the string library is no longer supporting redundant methods provided on str in the string library.
Instead of the code above, we should use code below for Python 3.x:

str.find("abcdijfHOWDYckfj", "HOWDY")

Python 3.1 File I/O open() Is No Longer Binary Mode By Default

After long holiday on my wedding preparation, D day and honeymoon, I returned back in shape.

Some things happened during the off days, such as the acquisition of SpringSource by VMWare, Inc.

I try to run my piece of XML parsing code like this in Python 3.1:

import xml.parsers.expat
import sys
import os.path

filename = "companies.xml"
parser = xml.parsers.expat.ParserCreate()
f = open(filename, "r")
parser.ParseFile(f)
f.close()

The code above throws an error like this:

TypeError: read() did not return a bytes object (type=str)

This source code works in Python 2.6, but failed when running on Python 3.1.

After comparing the manual for the built-in open() function between those 2 versions (2.6 and 3.x versions), I found out that there is a new feature in Python 3.x which is not backward compatibility (unlike transitions between 2.x versions, the transition from 2.x to 3.x may break the backward compatibility).

Python 3.x added the “t” for text, “b” for binary, “+” for updating (read/write) and “U” modifier to the open file mode.

It turns out to be that Python 3.1 no more handles file open as binary by default.Now the text (“t”) mode become default for Python 3.1 meanwhile Python 2.6 assume all file access are binary accesses. Python 3.x has implemented modes of more similarity to its C stdio library counterpart than its previous 2.6 version.

Since Python 3.x added additional parameter to the open() function, we must now specify “b” to make it binary access, so that the read() method will return bytes, otherwise it will return str.

import xml.parsers.expat
import sys
import os.path

xmlFilename = "companies.xml"
p = xml.parsers.expat.ParserCreate()
f = open(xmlFilename, "rb")
p.ParseFile(f)
f.close()

Now the ParseFile() method get what it asks for, a file handler with read() method that return bytes instead of str.

Micro Focus Acquired Borland Software…

While I’ve been busy preparing for my wedding day this Sunday, one recent acquisition captured my attention. I just received the information that Borland Software now acquired by Micro Focus. If you are developers groomed in the era of 90s, you should know or at least have heard  about this Borland Software. The company has been a major player in the Integrated Development Environment (IDE) software for popular languages at those times, such as TurboC, TurboC++, TurboPascal, TurboProlog, Borland Pascal, Delphi, and JBuilder series. For some time it also acquired the once famous dBase IV’s Ashton Tate, and have its own Quattro database. The IDE business was later totally spinned off to a wholly owned subsidiary named CodeGear.

Borland also produced good quality JEE application server series: Borland Enterprise Server, which was used with some of former employer’s clients.

Last 3-5 years, Borland Software had shifted its focus into Application Lifecycle Management (ALM), by acquiring companies such as Segue Software, Inc. I was sent by my employer that time for a training on their productsand sales knowledge of these ALM products (Borland SilkTest – automated testing tool, Borland SilkPerformer – load testing tool, Caliber) back to year 2006. These products compete with Mercury (now subsidiary of HP) Load Runner, IBM Rational Robot, etc.

Just recently this year we heard that Borland Software sold off CodeGear to Embarcadero Technologies. So, right now, Borland was left only with its ALM products and application servers/ORB brokers product, now sold to Micro Focus.

PyDev 1.4.7 on Eclipse Galileo

WARNING:

The content of this blog is obsolete now, as newer PyDev version 1.5 has been released. Please look at my latest blog post on this.

I begin to have more time to explore the Eclipse Galileo (3.5) again. This time I want to set it up for my Python development, using the PyDev plugin. Current PyDev plugin version is 1.4.7

Assuming you already have a working  installation of Galileo, and have opened a workspace.

The update site for PyDev is http://pydev.sourceforge.net/updates

In Galileo, you need choose: Help > Install New Software…

Adding the PyDev Plugin to Eclipse Galileo

The “Install” dialog will show up.

Click on the [Add] button at the top right of dialog. You should see this “Add Site” dialog.

Type in the data.

Name: Py Dev Update Site
Location: http://www.fabioz.com/pydev/

Click [OK] button.

Tick the checkbox “PyDev for Eclipse” under “PyDev”. Click [Next >] button.

Click [Next >].

Click the radio button “I accept the terms of the license agreement” when you agree. Click [Finish] button.

You will see the progress bar.

On completion of the installation process, Eclipse will ask you whether you want to restart.

Answer by clicking the [Yes] button.

Done.

Python’s Lazy Evaluation on Exception Handling

I tried a simple code like this:

try:
  while True:
    print("yipee")
except KeyboardInterrupt:
  print("w00t")

It runs successfully on command line interface, and keeps printing “yipee” until the user press Ctrl-C. After that I did a typo, which turns out to mistype the “KeyboardInterrupt” as “KeybaordInterrupt”.

try:
  while True:
    print("yipee")
except KeybaordInterrupt:
  print("w00t")

To my surprise, it still runs well, it keeps printing “yipee” to the screen. It’s just that
when I press Ctrl-C, Python threw this error:

Traceback (most recent call last):
  File "<stdin>", line 3, in <module>
KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 4, in <module>
NameError: name 'KeybaordInterrupt' is not defined
>>>

I looked at the documentation of Python 3.1 which says:
The try statement works as follows.

First, the try clause (the statement(s) between the try and except keywords) is executed.

• If no exception occurs, the except clause is skipped and execution of the try statement is finished.
• If an exception occurs during execution of the try clause, the rest of the clause is skipped. Then if its type matches the exception named after the except keyword, the except clause is executed, and then execution continues after the try statement.
• If an exception occurs which does not match the exception named in the except clause, it is passed on to outer try statements; if no handler is found, it is an unhandled exception and execution stops with a message as shown above.

The exception handling in Python works in a lazy manner, they will only validate the except clauses just before processing the exception!

Adding Embedded ActiveMQ to Spring Container (on Maven 2 Project)

Today, we need to add a queue to our application to better manage long running transaction on our web application. The choice fell into using embedded ActiveMQ.We plan to use the latest version available (which currently ActiveMQ 5.2.0). Previous version of our application use our proprietary code which I believe was an example of reinventing the wheel. For our latest version of application, we try to use as much as possible open standard and open source technologies. ActiveMQ is under the Apache Software Foundation umbrella which is suitable for us.

First I add the dependency for the latest version of ActiveMQ (version 5.2.0):

    <dependency>
    	<groupId>org.apache.activemq</groupId>
    	<artifactId>activemq-core</artifactId>
    	<version>5.2.0</version>
    	<optional>false</optional>
    </dependency>

Now it’s time to add something into the Spring application context configuration file.
As suggested by the documentation, I added new namespace amq in my XML. It points to “http://activemq.apache.org/schema/core http://activemq.apache.org/schema/core/activemq-core-5.2.0.xsd” schema location.

<?xml version="1.0" encoding="UTF-8" ?>
<beans xmlns="http://www.springframework.org/schema/beans"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xmlns:amq="http://activemq.apache.org/schema/core"
	xsi:schemaLocation="
		http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-2.5.xsd
		http://activemq.apache.org/schema/core http://activemq.apache.org/schema/core/activemq-core.xsd">

I tried to run a JUnit test just to make sure that the new change in the configuration works well. There were some 2 errors. It turns to be a stale schema location. I figured it out from opening the URL http://activemq.apache.org/schema/core and see what’s in there. So now need to modify a bit, change “http://activemq.apache.org/schema/core/activemq-core.xsd” to “http://activemq.apache.org/schema/core/activemq-core-5.2.0.xsd”.

So here goes the correct version that works (syntactically correct XML):

<beans xmlns="http://www.springframework.org/schema/beans"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xmlns:amq="http://activemq.apache.org/schema/core"
	xsi:schemaLocation="
		http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-2.5.xsd
		http://activemq.apache.org/schema/core http://activemq.apache.org/schema/core/activemq-core-5.2.0.xsd">

Now the next beast coming in, when I tried to use the new namespace by adding this inside the <beans/> tag.

	<amq:broker useJmx="false" persistent="false">
		<amq:transportConnectors>
			<amq:transportConnector uri="tcp://localhost:0" />
		</amq:transportConnectors>
	</amq:broker>

It produced this error:

java.lang.ExceptionInInitializerError
	at com.triquesta.tcm.core.services.MessagingServiceTest.init(MessagingServiceTest.java:17)
  [...deleted...]
Caused by: org.springframework.beans.factory.BeanDefinitionStoreException: Unexpected exception parsing XML document from class path resource [tcm_configs.xml]; nested exception is org.springframework.beans.FatalBeanException: NamespaceHandler class [org.apache.xbean.spring.context.v2.XBeanNamespaceHandler] for namespace [http://activemq.apache.org/schema/core] not found; nested exception is java.lang.ClassNotFoundException: org.apache.xbean.spring.context.v2.XBeanNamespaceHandler
	at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:420)
  [...deleted...]
Caused by: org.springframework.beans.FatalBeanException: NamespaceHandler class [org.apache.xbean.spring.context.v2.XBeanNamespaceHandler] for namespace [http://activemq.apache.org/schema/core] not found; nested exception is java.lang.ClassNotFoundException: org.apache.xbean.spring.context.v2.XBeanNamespaceHandler
	at org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.resolve(DefaultNamespaceHandlerResolver.java:134)
	at org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1292)
	at org.springframework.beans.factory.xml.BeanDefinitionParserDelegate.parseCustomElement(BeanDefinitionParserDelegate.java:1287)
  [...deleted...]
Caused by: java.lang.ClassNotFoundException: org.apache.xbean.spring.context.v2.XBeanNamespaceHandler
	at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
	at org.springframework.util.ClassUtils.forName(ClassUtils.java:211)
	at org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.resolve(DefaultNamespaceHandlerResolver.java:123)
	... 37 more