Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "JSDT"

(Development Plan)
(Key Features)
(67 intermediate revisions by 9 users not shown)
Line 1: Line 1:
= JavaScript Development Tools =
+
{{JSDT}}
 +
''JSDT is included with WTP 3.0 and above.''
  
== Introduction ==
+
The JavaScript Development Tools (JSDT) is a JavaScript IDE for Eclipse based on the Java Development Tools ([[JDT]]). It is our goal to make JSDT the most accurate JavaScript IDE while still keeping it very fast.  Since JSDT's foundation is in the [[JDT]], many of the rich editing features of the [[JDT]] carry over, as well as its facilities for smart error detection and correction, detailed flow analysis, pluggable content completion, and its flexible [[AST]] for use by plug-in developers. The end result is a fast, feature-packed JavaScript IDE and extensible framework that's well suited for AJAX and other JavaScript development needs.
The ATF team is proposing  to develop a new set JavaScript Editor/Development Tooling. The ATF team feels that a good JavaScript editor with a real JavaScript model for both AJAX and JavaScript developers. This effort would be an component of WST, since the WST project is scoped to do JavaScript development tools for the web. The JavaScript Development Tooling would be a WTP 3.0 2008 release item and would replace the existing JavaScript editor.
+
 
 +
JSDT is part of the Web Tools Platform Source Editing subproject.
  
 
== Description ==
 
== Description ==
  
With the advent of Web 2.0, JavaScript have become central in the creation of a richer user experience on the Web. Its use has shifted from the creation of simple functions and handlers to events, to the creation of complex Web Application frameworks. Such complexity makes it crucial that more sophisticated set of tool become available on Eclipse.
+
With the advent of Web 2.0, JavaScript has become central in the creation of a richer user experience on the Web. Its use has shifted from the creation of simple functions and events handlers to the creation of complex Web Application frameworks. Such complexity made it crucial that a more sophisticated set of tools become available in Eclipse.
  
The JavaScript Development Tools's goal will be to develop a framework for development of JavaScript applications, with full support for editing, refactoring, and searching. The JavaScript editor would be designed such that is can be plugged in to the Web Tools. The JavaScript Development Tools would be also be extensible such that new language features can easily be added.
+
JSDT's goal is to develop an IDE for JavaScript applications, with full support for editing, search, and refactoring. The functionality of the JavaScript Development Tools is heavily based on the functionality of the Java Development Tools, but since JavaScript is not a fully typed or class-based language, it is not possible to provide 100% of the JDT functionality.  JSDT is extensible in that it can be (is) plugged into the HTML and JSP editors within WTP as well as being architected with pluggable type inference and completion proposals in mind.  The inference engine is used to determine type and class structures from the JavaScript code, enabling as much of the JDT equivalent functionality as possible, while still allowing adopters to contribute to the process for atypical or extended scenarios.
  
The functionality of the JavaScript Development Tools will be heavily based on the functionality of the JDT. Because JavaScript is not a fully typed or class-based language, it will not be possible to provide 100% of the JDT functionality. Configurable capabilities will be provided to infer type and class structure from the JavaScript code, so as much JDT functionality as possible can be used.
+
JSDT is split up into three functional areas:
  
Functions provided include:
+
#Core - all of the core components, including, but not limited to, the parser, compiler, DOM and ASTs
 +
#[[/Debug|Debug]] - integrated debug support for Rhino and Crossfire
 +
#UI - all of the UI bits that drive the core
  
* Editor capabilities:
+
== Key Features ==
** Syntax highlighting
+
There are many features that the JDT has the the JSDT also has.
** Code folding
+
** Configurable formatting
+
** Code completion
+
** Content assist
+
*** Variable/function resolution
+
*** Resolution Context
+
** Quick fix
+
** syntax checking/error display
+
** Hover help/tips
+
** Occurences marking
+
** open selected item
+
** highlight matching parenthesis/brace/bracket
+
** add/remove/generate comment
+
** Typing helpers:
+
** Automatically close strings, parentheses, brackets,etc
+
** Automatically insert semicolons, braces
+
** automatic formatting
+
* Refactoring
+
** method- rename, move, delete, change signature
+
** var - rename, move, delete
+
** class (inferred) rename, move up/down
+
* Javadoc support (or JSDoc)
+
* Externalize strings (NLS support)
+
* Class hierarchy view
+
* Call hierarchy view
+
* Script explorer view
+
* Search references/declarations
+
* j(s)unit support
+
* Preferences:
+
** Appearance
+
** Templates
+
** Formatting
+
** Validation options
+
** Error/Warning levels
+
** Editor options
+
* Code Obfuscation
+
* Code Compression
+
  
== Proposed Design ==
+
A few of these key features are:
 +
 
 +
* Syntax Highlighting
 +
* Full outlining showing Classes, Functions and Fields
 +
* Highlight and check of matching bracket / parenthesis
 +
* Auto-complete of brackets, parentheses and indentation
 +
* Marking of Occurrences
 +
* Generation of element JSDoc
 +
* Smart Code Completion based on a real-time JavaScript Model
 +
* Hover Help that displays element declaration with JSDoc or Error message
 +
* Configurable Error/Warning checking including full language syntax and type/class structure resolution
 +
* Flow analysis showing unreachable code, unused variables and variable hiding.
 +
* Quick-fixes
 +
* Completion Templates
 +
* Extensible and customizable Code Formatting
 +
* Full Search
 +
* Refactoring - renaming, moving, member extraction
 +
* Support for user defined and browser libraries.
 +
 
 +
== Installation ==
 +
 
 +
JSDT is included in WebTools and in the Release Train aggregator site. So latest release can directly be installed from http://download.eclipse.org/releases/<luna|mars|...>.
 +
 
 +
* Milestones are accessible via the site of the next release (ie http://download.eclipse.org/releases/mars when next Eclipse release is Luna).
 +
* Snapshot builds are accessible via webtools integration site http://download.eclipse.org/webtools/downloads/drops/R3.7.0/ or via the JSDT-sepecific snapshot site http://download.eclipse.org/webtools/jsdt/snapshots (which may contain additional experimental features, not contributed to WebTools yet).
 +
 
 +
== Design ==
 
The JavaScript Development Tools design would use the JDT design with the necessary adjustments made for JavaScript.
 
The JavaScript Development Tools design would use the JDT design with the necessary adjustments made for JavaScript.
  
 
As far as the JavaScript Development Tools design is concerned, the major differences between Java and JavaScript are:
 
As far as the JavaScript Development Tools design is concerned, the major differences between Java and JavaScript are:
  
* Javascript has no explicit typing support, whereas in Java everything is typed.
+
* Javascript has no explicit typing support, whereas in Java everything is typed, and incorporates argument types in function signatures.
* At the top level, a JavaScript file can contain any program statement, whereas a Java file only contains a class.
+
* At the top level, a JavaScript file can contain any program statement, whereas a Java file only contains a Class.
* JavaScript has no classpath/jar file concept.
+
* JavaScript has no classpath/jar file concept
  
 
Other areas where the java/JavaScript differences will necessitate changes:
 
Other areas where the java/JavaScript differences will necessitate changes:
  
 
* syntax differences - parse definitions
 
* syntax differences - parse definitions
* additional program elements with no correspondence in java
+
* additional program elements with no correspondence in Java
** object literal
+
** object literals
 
** for (var in collection)
 
** for (var in collection)
  
 
=== Inferred Types ===
 
=== Inferred Types ===
  
In order for some JDT functionality (such as code completion) to work correctly, class type information needs to be available. This information is not available in JavaScript, but it can be inferred in many cases. A type inferring framework will be put in place to support this functionality. The type inferring will examine the JavaScript abstract syntax tree (AST), and generate "virtual" class information.
+
In order for some JDT-based functionality (such as code completion) to work correctly, class type information needs to be available. This information is not available in JavaScript, but it can be inferred in many cases. A type inferring framework has been put in place to support this functionality, examining the JavaScript Abstract Syntax Tree (AST) and generating "virtual" class information.  Type inferring is extensible, so the unique conventions among various JavaScript Toolkits (e.g. Dojo, jQuery, Prototype, etc.) can be handled, although through WTP 3.1 it has remained provisional.  Inferred types may participate in refactoring, but their visibility within the UI is still being discussed.
  
The type inferring will run off of a configuration will provide many options for how to infer the types/classes. The type inferring will also be extensible, so the unique conventions among various JavaScript toolkits can be handled. The type inferring will be configurable on a project basis, and possible on a file by file basis.
+
=== JavaScript file handling ===
  
The type inferring configuration will also be used by the refactoring function.  
+
Java files have a very top down structure, where files only contain classes, which only contain fields, methods, and inner classes, and program statements only contained within methods. Because of this, some JDT functionality will not work for JavaScript, because a program statement can be directly at the top of a JavaScript file. The relevant JDT code is still undergoing refactorings to support these scenarios.  
  
=== Javascript file handling ===
+
=== Variable/function resolution ===
  
Java files have a very top down structure, where files only contain classes, which only contain fields, methods, and classes, and program statements only contained within methods. Because of this, some JDT functionality will not work for JavaScript, because a program statement can be directly at the top of a JavaScript file. This will be handled by refactoring the relevant JDT code.  
+
In Java, everything is resolvable because of the classpath, package structure, and import statements. This has no correspondence in JavaScript, where functions themselves may also be resolvable as types.
  
=== Variable/function resolution ===
+
==== Libraries ====
  
In Java, everything is resolvable because of the classpath, package structure, and import statements. This has no correspondence in JavaScript. The function will be handled within JSDT by various means. When resolving functions/variables, JSDT will search all files in the same directory, files in referenced projects, files in referenced paths (configured by something like JDT "Java Build Path" page), and system API files (contained within JSDT).
+
The JSDT mimics the JDT Java Build Path and classpath container mechanisms to offer JavaScript library support. JSDT libraries are collections of JavaScript source files that have prototyped object/class definitions and JSDoc. The inference engine then models these libraries and places each object/field/function in the projects Global Scope, making them available to every JavaScript file in the project.  Because the library contents are not directly executed by JSDT, it isn't necessary for them to contain the complete implementation of those objects.  In fact, the standard JavaScript runtime is itself presented as a source file containing stubs for the specification's contents.  Bindings for nonstandard and future runtimes are similarly easy to create and use.
  
Because of the "loose" nature of JavaScript, many of the validation errors produced by the resolution code will be changed to warnings, or removed altogether. It may be desirable to configure what should be errors on a (JavaScript) file by file basis.  
+
To illustrate-- the JSDT contains a FireFox library plugin with about 150k of JavaScript and JsDoc.  This library represents the class structure within the FireFox browser that is accessible to a web page's JavaScript, but does not contain any implementation to the functions it declares.  If a user wishes to target their JavaScript source to FireFox specifically, they would add the FireFox library to their project and gain content completion and hover help for the FireFox objects. Users may also limit the objects/functions/fields visible in the project by adding or removing libraries.
 +
 
 +
Libraries aren't limited to browser objects.  AJAX runtimes can fit nicely into libraries, as would a website's standard set of utility functions.  Really the possibilities are limitless.  And the library mechanism is extremely easy to expand both by the end-user or through extension points.
  
 
=== Functionality mapping ===
 
=== Functionality mapping ===
Line 96: Line 91:
 
| '''JDT function''' || '''JSDT function'''
 
| '''JDT function''' || '''JSDT function'''
 
|-
 
|-
| Build path || include path (or something similar)  
+
| Build path || Libraries + Global Scope (frequently referred to as an "Include Path")
 
|-
 
|-
| JDK level (1.4 vs 1.5) || Ecma script level 3 vs 4  
+
| JDK level (1.4 vs 1.5) || ECMAscript level 3 vs 4 (v.3 supported now, v.4 will not be implemented as the specification was abandoned)
 
|-
 
|-
| Compile || validation
+
| Compile || Validation & flow analysis
 
|}
 
|}
 +
 
=== Extension Points ===
 
=== Extension Points ===
  
The JSDT will functionality will be embedded. This means, for instance, the JavaScript editing capabilities will be embeddable within HTML and XML editors, both within script tags, and script attribute values.
+
The JSDT functionality is embeddable. This means, for instance, that the JavaScript editing capabilities is embeddable within HTML and JSP Editors, both within script tags, and script attribute values.  The JSDT is flexible so script support in other languages is possible using translator interfaces being planned for WTP 3.1.
  
The following jsdt.core extension points will be supported :
+
The following JSDT extension points are supported :
  
* include path variable initializer
+
* Global Scope variable initializer
* include path container initializer
+
* Global Scope container initializer core
* code formatter
+
* Code formatter
* validation participant
+
* Validation participant
  
In addition, the JavaScript syntax tree will be presented as an XML dom, so that various XML processors can be run against it for a variety of reasons, for instance, a Schematron processor could be used to do validation.
+
<!--In addition, the JavaScript syntax tree will be presented as an XML dom (future), so that various XML processors can be run against it for a variety of reasons, for instance, a Schematron processor could be used to do validation.-->  Currently the JSDT is represented in an AST.
  
 
The following jsdt.ui extension points will be supported :
 
The following jsdt.ui extension points will be supported :
  
 +
* Global Scope container initializer ui  (Wizzard, content assist images and type/text naming)
 
* javascript element filter
 
* javascript element filter
 
* javaScriptEditorTextHovers
 
* javaScriptEditorTextHovers
* javadocCompletionProcessor
+
* jsdocCompletionProcessor
 
* quickFixProcessors
 
* quickFixProcessors
 
* quickAssistProcessors
 
* quickAssistProcessors
* includepathContainerPage
 
 
* foldingStructureProviders
 
* foldingStructureProviders
 
* queryParticipants
 
* queryParticipants
Line 128: Line 124:
 
* javaScriptCompletionProposalSorters
 
* javaScriptCompletionProposalSorters
  
 +
== Development ==
  
=== Development Progress ===
+
* [[JSDTDevelopment |Developing JSDT ]]
 
+
* Copied the 3.3 level JDT code.
+
* refactored java -> JavaScript , org.eclipse.jdt -> org.eclipse.wst.jsdt, etc .
+
* updated syntax definitions, parsing, etc to JavaScript
+
* created type/class inference engine
+
* update/refactor jdt junit tests to JavaScript and make work [partial]
+
* update ui
+
* disabled functions not applicable to a generic JavaScript model
+
* added usage for non standard (but common) use cases in the inference engine
+
* created extensions plugins for WST HTML/JSP editor to support JSDT features
+
* changed buildpath/classpath mechanism to define and manage the projects Global Scope (libraries).
+
* created Global Scope library for FireFox through by using reflection utility function to dump all visible objects/properties inside FireFox (partial needs some manual updates).
+
* created Global Scope library for IE by scraping MSDN JScript docs.
+
  
  
=== Future Development Plan ===
+
[[Category:Eclipse Web Tools Platform Project]][[Category:JSDT]]
The continued plan is as follows:
+
* determine what code is unchanged from JDT and figure out how to share with JDT
+
* Support for one or two popular toolkits such as dojo ((partial but non-specific))
+
* Expose ast as XML dom
+
* Refactoring
+
* Remove non applicable possibilities
+
* Enhanced the inference support for 'conglomerate types' and type mixins. ((Types existing in the Global Scope should better track method/field origination and inheritenc))
+
* Add more JavaScript specific error/warning scenarios.
+
* Enhance HTML integration to provide HTML DOM completions where applicable.
+
* Some UI cleanup (hide library paths/use names provided by library plugins)
+

Revision as of 05:41, 14 April 2015


JSDT
Website
Download
Community
Mailing ListForumsIRCmattermost
Issues
OpenHelp WantedBug Day
Contribute
Browse Source


JSDT is included with WTP 3.0 and above.

The JavaScript Development Tools (JSDT) is a JavaScript IDE for Eclipse based on the Java Development Tools (JDT). It is our goal to make JSDT the most accurate JavaScript IDE while still keeping it very fast. Since JSDT's foundation is in the JDT, many of the rich editing features of the JDT carry over, as well as its facilities for smart error detection and correction, detailed flow analysis, pluggable content completion, and its flexible AST for use by plug-in developers. The end result is a fast, feature-packed JavaScript IDE and extensible framework that's well suited for AJAX and other JavaScript development needs.

JSDT is part of the Web Tools Platform Source Editing subproject.

Description

With the advent of Web 2.0, JavaScript has become central in the creation of a richer user experience on the Web. Its use has shifted from the creation of simple functions and events handlers to the creation of complex Web Application frameworks. Such complexity made it crucial that a more sophisticated set of tools become available in Eclipse.

JSDT's goal is to develop an IDE for JavaScript applications, with full support for editing, search, and refactoring. The functionality of the JavaScript Development Tools is heavily based on the functionality of the Java Development Tools, but since JavaScript is not a fully typed or class-based language, it is not possible to provide 100% of the JDT functionality. JSDT is extensible in that it can be (is) plugged into the HTML and JSP editors within WTP as well as being architected with pluggable type inference and completion proposals in mind. The inference engine is used to determine type and class structures from the JavaScript code, enabling as much of the JDT equivalent functionality as possible, while still allowing adopters to contribute to the process for atypical or extended scenarios.

JSDT is split up into three functional areas:

  1. Core - all of the core components, including, but not limited to, the parser, compiler, DOM and ASTs
  2. Debug - integrated debug support for Rhino and Crossfire
  3. UI - all of the UI bits that drive the core

Key Features

There are many features that the JDT has the the JSDT also has.

A few of these key features are:

  • Syntax Highlighting
  • Full outlining showing Classes, Functions and Fields
  • Highlight and check of matching bracket / parenthesis
  • Auto-complete of brackets, parentheses and indentation
  • Marking of Occurrences
  • Generation of element JSDoc
  • Smart Code Completion based on a real-time JavaScript Model
  • Hover Help that displays element declaration with JSDoc or Error message
  • Configurable Error/Warning checking including full language syntax and type/class structure resolution
  • Flow analysis showing unreachable code, unused variables and variable hiding.
  • Quick-fixes
  • Completion Templates
  • Extensible and customizable Code Formatting
  • Full Search
  • Refactoring - renaming, moving, member extraction
  • Support for user defined and browser libraries.

Installation

JSDT is included in WebTools and in the Release Train aggregator site. So latest release can directly be installed from http://download.eclipse.org/releases/<luna|mars|...>.

Design

The JavaScript Development Tools design would use the JDT design with the necessary adjustments made for JavaScript.

As far as the JavaScript Development Tools design is concerned, the major differences between Java and JavaScript are:

  • Javascript has no explicit typing support, whereas in Java everything is typed, and incorporates argument types in function signatures.
  • At the top level, a JavaScript file can contain any program statement, whereas a Java file only contains a Class.
  • JavaScript has no classpath/jar file concept

Other areas where the java/JavaScript differences will necessitate changes:

  • syntax differences - parse definitions
  • additional program elements with no correspondence in Java
    • object literals
    • for (var in collection)

Inferred Types

In order for some JDT-based functionality (such as code completion) to work correctly, class type information needs to be available. This information is not available in JavaScript, but it can be inferred in many cases. A type inferring framework has been put in place to support this functionality, examining the JavaScript Abstract Syntax Tree (AST) and generating "virtual" class information. Type inferring is extensible, so the unique conventions among various JavaScript Toolkits (e.g. Dojo, jQuery, Prototype, etc.) can be handled, although through WTP 3.1 it has remained provisional. Inferred types may participate in refactoring, but their visibility within the UI is still being discussed.

JavaScript file handling

Java files have a very top down structure, where files only contain classes, which only contain fields, methods, and inner classes, and program statements only contained within methods. Because of this, some JDT functionality will not work for JavaScript, because a program statement can be directly at the top of a JavaScript file. The relevant JDT code is still undergoing refactorings to support these scenarios.

Variable/function resolution

In Java, everything is resolvable because of the classpath, package structure, and import statements. This has no correspondence in JavaScript, where functions themselves may also be resolvable as types.

Libraries

The JSDT mimics the JDT Java Build Path and classpath container mechanisms to offer JavaScript library support. JSDT libraries are collections of JavaScript source files that have prototyped object/class definitions and JSDoc. The inference engine then models these libraries and places each object/field/function in the projects Global Scope, making them available to every JavaScript file in the project. Because the library contents are not directly executed by JSDT, it isn't necessary for them to contain the complete implementation of those objects. In fact, the standard JavaScript runtime is itself presented as a source file containing stubs for the specification's contents. Bindings for nonstandard and future runtimes are similarly easy to create and use.

To illustrate-- the JSDT contains a FireFox library plugin with about 150k of JavaScript and JsDoc. This library represents the class structure within the FireFox browser that is accessible to a web page's JavaScript, but does not contain any implementation to the functions it declares. If a user wishes to target their JavaScript source to FireFox specifically, they would add the FireFox library to their project and gain content completion and hover help for the FireFox objects. Users may also limit the objects/functions/fields visible in the project by adding or removing libraries.

Libraries aren't limited to browser objects. AJAX runtimes can fit nicely into libraries, as would a website's standard set of utility functions. Really the possibilities are limitless. And the library mechanism is extremely easy to expand both by the end-user or through extension points.

Functionality mapping

This table shows how the JDT functionality corresponds to the JavaScript functionality. It does not include anything where there is a direct one to one correspondence.

JDT function JSDT function
Build path Libraries + Global Scope (frequently referred to as an "Include Path")
JDK level (1.4 vs 1.5) ECMAscript level 3 vs 4 (v.3 supported now, v.4 will not be implemented as the specification was abandoned)
Compile Validation & flow analysis

Extension Points

The JSDT functionality is embeddable. This means, for instance, that the JavaScript editing capabilities is embeddable within HTML and JSP Editors, both within script tags, and script attribute values. The JSDT is flexible so script support in other languages is possible using translator interfaces being planned for WTP 3.1.

The following JSDT extension points are supported :

  • Global Scope variable initializer
  • Global Scope container initializer core
  • Code formatter
  • Validation participant
 Currently the JSDT is represented in an AST.

The following jsdt.ui extension points will be supported :

  • Global Scope container initializer ui (Wizzard, content assist images and type/text naming)
  • javascript element filter
  • javaScriptEditorTextHovers
  • jsdocCompletionProcessor
  • quickFixProcessors
  • quickAssistProcessors
  • foldingStructureProviders
  • queryParticipants
  • javaScriptCompletionProposalComputer
  • javaScriptCompletionProposalSorters

Development

Back to the top