larstimm/vertx-codegen

Vert.x API Generation

This projects contains tools which allow idiomatic other language API shims to be generated from Java APIs.

API generator

A code generator consist of an MVEL template declared in a codegen.json descriptor:

{
  "name": "Groovy",
  "generators": [ {
    "kind": "class",
    "fileName": "'groovy/' + fqn.replace('io.vertx', 'io.vertx.groovy').replace('.', '/') + '.groovy'",
    "templateFileName": "vertx-groovy/template/groovy.templ"
  } ]
}

• fileName is an MVEL expression for the file name, returning null skips the generation.
• templateFileName is the name of the MVEL template to apply
• kind: there are several kinds of generators for different use cases
  • class : applied on each API classes
  • package : applied on each Java package
  • module : applied on each declared module, a module uniquely identifies an API
  • dataObject: applied on each data object class
  • proxy: applied on each proxy class

There can be as many generators as you like.

Processor configuration

By default the processor will only validate the source API against the Codegen rules and will not perform code generation. Code generation will occur when the processor outputDirectory option is configured:

<pluginManagement>
  <plugins>
    <!-- Configure the execution of the compiler to execute the codegen processor -->
    <plugin>
      <artifactId>maven-compiler-plugin</artifactId>
      <version>3.1</version>
      <configuration>
        <source>1.8</source>
        <target>1.8</target>
        <encoding>${project.build.sourceEncoding}</encoding>
      </configuration>
      <executions>
        <execution>
          <id>default-compile</id>
          <configuration>
            <annotationProcessors>
              <annotationProcessor>io.vertx.codegen.CodeGenProcessor</annotationProcessor>
            </annotationProcessors>
            <compilerArgs>
              <arg>-AoutputDirectory=${project.basedir}/src/main</arg>
            </compilerArgs>
          </configuration>
        </execution>
      </executions>
    </plugin>
  </plugins>
</pluginManagement>

API constraints

In order for code generation to work effectively, certain constraints are put on the Java interfaces.

The constraints are

• The API must be described as a set of Java interfaces, classes are not permitted
• Default methods are not permitted
• Nested interfaces are not permitted
• All interfaces to have generation performed on them must be annotated with the io.vertx.codegen.annotations.VertxGen annotation
• Fluent methods (methods which return a reference to this) must be annotated with the io.vertx.codegen.annotations.Fluent annotation
• Data object classes (classes which provide data (e.g. configuration) to methods) must be annotated with the io.vertx.codegen.annotations.DataObject annotation
• Data object classes must provide a constructor which takes a single io.vertx.core.json.JsonObject parameter.
• Methods where the return value must be cached in the API shim must be annotated with the io.vertx.codegen.annotations.CacheReturn annotation
• Only certain types are allowed as parameter or return value types for any API methods (defined below).

Permitted types

We define the following set B of basic types:

• any primitive type
• any boxed primitive type
• java.lang.String

We define J as the set of types io.vertx.core.json.JsonObject and io.vertx.core.json.JsonArray

We define V as the set of user defined API types which are defined in its own interface and annotated with @VertxGen

The following set P of types are permitted as parameters to any API method:

• the set B
• java.lang.Object
• the set V
• the set J
• any data object class annotated with @DataObject
• type java.util.List<C> or java.util.Set<C> where C contains
  • the set B
  • the set V
  • the set J
• type java.util.Map<String, C> where C contains
  • the set B
  • the set J
  • the set V
• any Enum class
• the exact java.lang.Throwable class, for instance java.lang.Exception is not supported
• io.vertx.java.core.Handler<io.vertx.java.core.AsyncResult<HA>> where HA contains
  • the set B
  • the set V
  • the set J
  • java.lang.Void
  • java.lang.Throwable
  • any data object class annotated with @DataObject
  • type java.util.List<C> or java.util.Set<C> where C contains
    • the set B
    • the set V
    • the set J
• io.vertx.java.core.Handler<H> where H contains
  • the set HA
  • java.lang.Throwable

The following set R of types are permitted as return types from any API method:

• void
• the set B
• the set V
• the set J
• any Enum class
• any java.lang.Throwable
• any data object class annotated with @DataObject
• type java.util.List<C> or java.util.Set<C> where C contains
  • the set B
  • the set J
  • the set V
  • any data object class annotated with @DataObject
• type java.util.Map<String, C> where C contains
  • the set B
  • the set J

Static factory methods

You may add static factory methods in your interfaces, e.g.

interface MyInterface {

    static MyInterface newInterface(String foo) {
      return new ....
    }

}

Super interfaces

Interfaces can extend other interfaces which also have the @VertxGen annotation.

Concrete/abstract interfaces

Interfaces annotated with @VertxGen can either be concrete or abstract, such information is important for languages not supporting multiple class inheritance like Groovy:

• interfaces annotated with @VertxGen(concrete = false) are meant to be extended by concrete interfaces and can inherit from abstract interfaces only.
• interfaces annotated with @VertxGen or @VertxGen(concrete = true) are implemented directly by Vertx and can inherit at most one other concrete interface and any abstract interface

Ignoring methods

If you do not wish a method to be used for generation you can annotate it with the @GenIgnore annotation.

Modules

Generated types must belong to a module: a java package annotated with @GenModule that defines a module, modules cannot be nested. Such file is created in a file package-info.java.

In addition of the package name, a module must define a name used when generating languages that don't follow Java package naming, like JavaScript or Ruby.

@GenModule(name = "vertx-unit")
package io.vertx.ext.unit;

For non Vert.x modules, the @GenModule annotation provides the groupPackageName member to define the package of the group used for generating the generated package names (for Groovy or RxJava generation):

@GenModule(name = "acme", groupPackageName="com.acme")
package com.acme.myservice;

The group package name must be a prefix of the annotated module, it defines the naming of the generate packages o for the modules that belongs to the same group, in this case:

• com.acme.groovy... for Groovy API
• com.acme.rxjava... for RxJava API

For this particular com.acme.myservice module we have:

• com.acme.groovy.myservice for Groovy API
• com.acme.rxjava.myservice for RxJava API

NOTE: the default group name is io.vertx and should only be used by Vert.x projects or extensions.

Templates

We use MVEL templating to generate APIs.

There should be a single MVEL template for each language API that is to be generated.

The template will be called once for each interface that is annotated with @VertxGen in the Java API. One output file (e.g. one .js file) will be created for each Java interface.

Template variables for class models

The following variables are made available to templates:

• ifaceSimpleName - the simple name of the Java interface
• ifaceFQCN - the fully qualified class name of the Java interface
• ifacePackageName - the name of the Java package the Java interface belongs to
• ifaceComment - the class comment from the Java interface
• concrete - true when the interface is implemented by vert.x useful to decide the generation of a class or interface in the API shim
• helper - a helper class that of type io.vertx.codegen.Helper which contains useful methods for things such as converting CamelCase to underscores.
• methods - a list of MethodInfo objects describing each method in the interface.
• referencedTypes - a list of strings representing the set of user defined types (also annotated with VertxGen) which are referenced from the current interface
• superTypes - a list of TypeInfo representing the set of user defined types which the current interface extends from
• concreteSuperTypes - subset of superTypes which are concrete
• abstractSuperTypes - subset of superTypes which are abstract
• methodMap - this is a Map<String, MethodInfo> - which allows you to look up all methods with a given name
• importedTypes- this is a Set<TypeInfo> containing the types used by this class

The TypeInfo represents a Java type:

• name. Generates a string of a form suitable for representing this type in source code using qualified names, for instance io.vertx.core.Handler<io.vertx.core.buffer.Buffer>
• simpleName. Generates a string of a form suitable for representing this type in source code using simple names, for instance Handler<Buffer>
• toString. Same as name
• collectImports(Collection<TypeInfo.Class> imports). Collect all imports required by this type

The TypeInfo.Class is a subclass of TypeInfo representing a Java class:

• kind. An enum providing more information about the type
  • STRING, BOXED_PRIMITIVE, PRIMITIVE: basic types
  • JSON_OBJECT, JSON_ARRAY: io.vertx.core.json.JsonObject and io.vertx.core.json.JsonArray
  • THROWABLE: java.lang.Throwable
  • VOID: java.lang.Void
  • OBJECT: java.lang.Object
  • LIST, SET: corresponding java collections
  • API: a type annotated with @VertxGen
  • DATA_OBJECT: a type annotations with @DataObject
  • HANDLER: io.vertx.core.Handler
  • ASYNC_RESULT: io.vertx.core.AsyncResult
  • ENUM: An enum
  • OTHER: anything else

The MethodInfo object has the following fields:

• name. The name of the method
• kind. The method kind
  • HANDLER: last parameter type is io.vertx.core.Handler<T> and a void or fluent return
  • FUTURE: last parameter type is io.vertx.core.Handler<io.vertx.core.AsyncResult<T>> and a void or fluent return
  • INDEX_GETTER: an index getter
  • INDEX_SETTER: an index setter
  • OTHER: anything else
• returnType. The fully qualified return type (or void) of the method
• fluent. true if the method is fluent (i.e. returns a reference to the interface itself for chaining calls)
• cacheReturn. true if the generated API method should cache return value
• comment. Method comment.
• params. List of ParamInfo objects representing the parameters of the method.
• staticMethod. true if it's a static method.
• typeParams. The list of the type parameters declared by the method

The ParamInfo object has the following fields:

• name. The name of the parameter
• type. The type of the parameter as a TypeInfo
• dataObject. true If the parameter is a data object type.

Template variables in data object models

• type - the TypeInfo of the current option
• doc - the Doc object
• concrete" - true when the option is implemented by vert.x - useful to decide the generation of a class or interface in the API shim
• generateConverter - whether a converter should be generated or not
• inheritConverter - whether the generated converter should convert all properties
• properties - a Set<PropertyInfo> of the available properties in this option
• importedTypes - the imported types by the option
• superTypes - a list of TypeInfo representing the set of user defined types which the current interface extends from
• superType - the supertype of this option ???

The PropertyInfo object has the following fields:

• name. The name of the property
• type. The type of the property as TypeInfo
• doc - the Doc object
• declared. True if the property is declared by its data object and does not override the same property from an ancestor
• writerMethod. The name of the setter/adder method in Java
• readerMethod. The optional name of the getter method in Java
• array. True if the property is an array
• adder. True if the property is an adder (addSomething)
• jsonifiable. True if the object can be converted somehow to json