Lambdas

A lambda consists of a sequence of statements that can be bound to a variable. The variable can be copied and called as needed. Unlike most languages, Pyrope only supports anonymous lambdas. The reason is that without it lambdas would be assigned to a namespace. Supporting namespaces would avoid aliases across libraries, but Pyrope allows different versions of the same library at different parts of the project. This will effectively create a namespace alias. The solution is to not have namespaces but relies upon variable scope to decide which lambda to call.

Observation

Allowing multiple version of the same library/code is supported by Pyrope. It looks like a strange feature from a software point of view, but it is common in hardware to have different blocks designed/verified at different times. The team may not want to open and modernize a block. In hardware, it is also common to have different blocks to be compiled with different compiler versions. These are features that Pyrope enables.

Pyrope divides the lambdas into two categories: functions and procedures. Functions operate only over combinational logic. They can not have any synthesis side-effect. This means the function outputs are only a function of the function inputs. Any external call can only affect debug statements not the synthesizable code. functions resemble pure functions in normal programming languages. In pure functions, the function results depend only on the input parameters. In Pyrope, they are allowed to have side effects on debug code (non-synthesizable).

Non-function lambdas are called procedures or methods. The only difference between procedures and methods is that a method has self as the first argument in the output which allows to mutable the called tuple.

Lambdas also can be divided into modules and non-modules. A module is a lambda visible at synthesis call hierarchy. A non-module is an inlined or flattened lambda.

functions are combinational logic, but procedures can have inputs and/or outputs registerd or just be a generic pure combinational function.

Combinational (fun)Combinational (proc)Inputs Registerd (proc)Outputs Registerd (proc)

let add=fun(a,b)->(res) {
  res = a+b
}

fun add(a,b)->(res) {  // Same as let add=fun(a,b)->(res)
  res = a+b
}

let add=proc(a,b)->(res) {  // nicer to use fun, but proc works
  res = a+b
}

proc add(a,b)->(res) {  // same
  res = a+b
}

let add=proc(reg a, reg b)->(res) {
  res = a+b
}

proc add(reg a, reg b)->(res) { // same
  res = a+b
}

let add=proc(a, b)->(reg res) {
  res = a+b
}

proc add(a, b)->(reg res) { // same
  res = a+b
}

Declaration

Only anonymous lambdas are supported, this means that there is no global scope for functions, procedures, or modules. The only way for a file to access a lambda is to have access to a local variable with a definition or to "import" a variable from another file. The more familiar fun name or proc name declaration is also valid, but it is syntax sugar and equivalent to let name = fun.

let a_3   = {   3 }      // just scope, not a lambda. Scope is evaluate now
let a_fun = fun() { 4 }  // when a_fun is called 4 is returned

let fun3 = fun(){ 5 }    // public lambda that can be imported by other files

let x = a_3()            // compile error, explicit call not posible in scope
let x = a_fun()          // OK, explicit call needed when no arguments

assert a_3() equals 3
assert a_fun equals _:fun()
assert a_fun() equals 4
assert a_fun() == 4      // calls to eval the function

The lambda definition has the following fields:

[GENERIC] [CAPTURE] [INPUT] [-> OUTPUT] [where COND] |

• GENERIC is an optional comma separated list of names between < and > to use as generic types in the lambda.

• CAPTURE has the list of capture variables for the lambda. If no capture is provided, no local variable can be captured by value which is equivalent to an empty list ([]), The captures are by value only, no capture by reference is allowed. Unlike most languages, capture must be comptime. Section Closures has more details.

• INPUT has a list of inputs allowed with optional types. () indicates no inputs. (...args) allow to accept a variable number of arguments.

• OUTPUT has a list of outputs allowed with optional types. () indicates no outputs.

• COND is the condition under which this statement is valid. The COND can use the inputs, outputs, and self to evaluate. If the outputs are used in the COND, the lambda must be immutable (fun). This means that the method is called when the condition could evaluate true depending on its execution, but being immutable there are no side effects. Section overload has more details.

var add:fun(...x) = _
add = fun(...x) { x.0+x.1+x.2 }      // no IO specified
add = fun(a,b,c){ a+b+c }            // constrain inputs to a,b,c
add = fun(a,b,c){ a+b+c }            // same
add = fun(a:u32,b:s3,c){ a+b+c }     // constrain some input types
add = fun(a,b,c) -> (x:u32){ a+b+c } // constrain result to u32
add = fun(a,b,c) -> (res){ a+b+c }   // constrain result to be named res
add = fun(a,b:a,c:a){ a+b+c }        // constrain inputs to have same type
add = fun<T>(a:T,b:T,c:T){ a+b+c }   // same

x = 2
var add2:fun2(a) = _
add2 = fun       (a){   x + a }    // compile error, undefined 'x'
add2 = fun[     ](a){   x + a }    // compile error, undefined 'x'
add2 = fun[x    ](a){   x + a }    // explicit capture x
add2 = fun[foo=x](a){ foo + a }    // capture x but rename to something else

var y = (
  ,val:u32 = 1
  ,inc1 = fun (ref self) { self.val = u32(self.val + 1) }
)

let my_log::[debug] = fun (...inp) {
  print "loging:"
  for i in inp {
    print " {}", i
  }
  puts
}

let f = fun<X>(a:X,b:X){ a+b }   // enforces a and b with same type
assert f(33:u22,100:u22)

my_log a, false, x+1

Argument naming

Input arguments must be named. E.g: fcall(a=2,b=3) There are the following exceptions that avoid naming arguments:

• If the type system can distinguish between unnamed arguments (no ambiguity)

• If there is an argument/call match. The calling variable name has the same as an argument

• If the argument is a single letter, and there is no name match, only position is used

• self does not need to be named (first argument position)

There are several rules on how to handle arguments.

• Calls use the Uniform Function Call Syntax (UFCS) but only when self is defined as first argument. (a,b).f(x,y) == f((a,b),x,y)

• Pipe |> concatenated inputs: (a,b) |> f(x,y) == f(x,y,a,b)

• Function calls with arguments do not need parenthesis after newline or a variable assignment: a = f(x,y) is the same as a = f x,y

• Functions without arguments, need explicit parenthesis in function call.

Pyrope uses a Uniform Function Call Syntax (UFCS) when the first argument is self. It resembles Nim or D UFCS but it can be different from the order in other languages. Notice the different order in UFCS vs pipe, and also that in the pipe the argument tuple is concatenated.

let div  = fun (self,b) { self / b }  // named input tuple
let div2 = fun (...x){ x.0 / x.1 }    // unnamed input tuple

let noarg = fun () { 33 }         // explicit no args

assert 33 == noarg()              // () needed to call

assert noarg // compile error, `noarg()` needed for calls without arguments

a=div(3  , 4  , 3)       // compile error, div has 2 inputs
b=div(self=8, b=4)       // OK, 2
c=div self=8, b=4        // compile error, parenthesis needed for complex call
d=(self=8).div(b=2)      // OK, 4
d=(8).div(b=2)           // OK, 4 . self does not need to be named
d=8.div(2)               // OK, single character inputs no need to be named
e=(self=8).div b=2       // compile error, parenthesis needed for complex call

h=div2(8, 4, 3)          // OK, 2 (3rd arg is not used)
i=8.div2(4,3)            // compile error, no self in div2

j=(8,4)  |> div2         // OK, 2, same as div2(8,4)
j=(8,4)  |> div2()       // OK, 2, same as div2(8,4)
k=(4)    |> div2(8)      // OK, 2, same as div2(8,4)
l=(4,33) |> div2(8)      // OK, 2, same as div2(8,4,33)
m=4      |> div2 8       // compile error, parenthesis needed for complex call

n=div((8,4), 3)          // compile error: (8,4)/3 is undefined
o=(8,4).div2(1)          // compile error: (8,4)/1 is undefined

The UFCS allows to have lambdas to call any tuple, but if the called tuple has a lambda defined with the same name a compile error is generated. Like with variables, Pyrope does not allow lambda call shadowing. Polymorphism is allowed but only explicit one as explained later.

var tup = (
  ,let f1 = fun(self) { 1 }
)

let f1 = fun (self){ 2 }   // compile error, f1 shadows tup.f1
let f1 = fun (){ 3 }       // OK, no

assert f1()         != 0  // compile error, missing argument
assert f1(tup)      != 0  // compile error, f1 shadowing (tup.f1 and f1)
assert 4.f1()       != 0  // compile error, f1 can be called for tup, so shadow
assert tup.f1()     != 0  // compile error, f1 is shadowing

let xx = fun[tup] { tup.f1() } // OK, function restricted scope for f1
assert xx()

assert (4:tup).f1() == 1
assert 4.f2()       == 3  // UFCS call
assert tup.f1()     == 1

The keyword self is used to indicate that the function is accessing a tuple. self is required to be the first argument. If the procedure modifies the tuple contents, a ref self must be passed as input.

var tup2 = (
  ,val:u8 = _
  ,upd = proc(ref self) { self.val::[saturate] += 1 }
  ,calc = fun(self) { self.val}
)

A lambda call uses parenthesis (foo() or foo(1,2)). The parenthesis can be avoid in tree conditions: (1) arguments are passed in a simple function call statement; (2) after a pipeline directive; (3) the variable has a getter method (get).

no_arg_fun()     // must use explicit parenthesis/called
arg_fun 1,2      // parenthesis are optional
arg_fun(1,2)     // OK too
(1,2) |> arg_fun // OK too, it is after |>

var intercepted:(
 ,field:u32
 ,getter=fun(self) { self.field + 1 }
 ,setter=fun(ref self,v ) { self.field = v }
) = 0

cassert intercepted == 1  // will call get method without explicit call
cassert intercepted.field == 0

Pass by reference

Pyrope is an HDL, and as such, there are not memory allocation issues. This means that all the arguments are pass by value and the language has value semantics. In other words, there is not need to worry about ownership or move/forward semantics like in C++/Rust. All the arguments are always by value. Nevertheless, sometimes is useful to pass a reference to an array/register so that it can be updated/accessed on different lambdas.

Pyrope arguments are by value, unless the ref keyword is used. Pass by reference is needed to avoid the copy by value of the function call. Unlike non-hardware languages, there is no performance overhead in passing by value. The reason for passing as reference is to allow the lambda to operate over the passed argument. If modified, it behaves like if it were an implicit output. This is quite useful for large objects like memories to avoid the copy.

The pass by reference behaves like if the calling lambda were inlined in the caller lambda while still respecting the lambda scope. The ref keyword must be explicit in the lambda input definition but also in the lambda call. The lambda outputs can not have a ref modifier.

No logical or arithmetic operation can be done with a ref. As a result, it is only useful for lambda input arguments.

let inc1 = fun(ref a) { a += 1 }

let x = 3
inc1(ref x)       // compile error, `x` is immutable but modified inside inc1

var y = 3
inc1(ref y)
assert y == 4

let banner = fun() { puts "hello"  }
let execute_method = fun(fn:fun()->()) {  // example with explicit type for fn
  fn() // prints hello when banner passed as argument
}

execute_method(banner)     // OK

In Pyrope, to call a method, parenthesis are needed only when the method has arguments. This is needed to distinguish for higher order functions that need to distinguish between a function call and a pass of the lambda.

Output tuple

Pyrope everything is a tuple, even the output or return from a lambda. When a single element is returned, it can be an unnamed tuple by omiting parenthesis.

let ret1 = fun()->(a:int) { // named
  a = 1
}

let ret2 = fun()->a:int {   // unnamed
  a = 2
}

let ret3 = fun()->(a,b) {   // named
  a = 3
  b = 4
}

let a1 = ret1()
assert a1.a == 1 // NOT a1 == 1

let a2 = ret2()
assert a2 == 1   // NOT a2.a == 1

let a3 = ret3()
assert a3.a == 3 and a2.b == 4

let (x1,x2) = ret3()
assert x1   == 3 and x2   == 4

Attributes

Variables can have attributes, but procedures can also have them. Procedure attributes have only one direction from inside the method to outside/caller. They can be used to signal out of band information about the procedude. Attributes can only be integer, bool, or string. Depending on the type, they are initialized to 0, false, or "".

The procedure attribute is stored in the variable that keeps the lambda. This means that it can be checked before or after the lambda call, and that different variables can point to the same procedure but keep different attributes.

let p1 = proc(a)->(res) {
  self.[my_zero_found] or= (a == 0)

  res = a + 1
}

let p2 = p1      // copy
let p3 = ref p1  // reference

test "testing p1" {
  assert p1.[my_zero_found] == false
  assert p2.[my_zero_found] == false

  cassert p1(3) == 4
  assert p1.[my_zero_found] == false

  cassert p1(0) == 1
  assert p1.my_zero_found == true

  cassert p1(50) == 51
  assert p1.[my_zero_found] == true
  assert p2.[my_zero_found] == false
  assert p3.[my_zero_found] == true
}

Methods

Pyrope arguments are by value, unless the ref keyword is used. ref is needed when a method intends to update the tuple contents. In this case, ref self argument behaves like a pass by reference in non-hardware languages. This means that the tuple fields are updated as the method executes, it does not wait until the method finishes execution. A method without the ref keyword is a pass by value call. Since all the inputs are immutable by default (let), any self updates should generate a compile error.

let Nested_call = (
  ,var x = 1
  ,let outter= proc(ref self) {  self.x = 100 ; self.inner(); self.x = 5 }
  ,let inner = fun(self) { assert self.x == 100 }
  ,let faulty = proc(self) { self.x = 55 } // compile error, immutable self
  ,proc okcall(ref self) { self.x = 55 }   // equivalent to let okcall=proc
)

self can also be returned but this behaves like a normal copy by value variable return.

var a_1 = (
  ,x:u10
  ,let f1 = fun(ref self,x)->(self) { // BOTH ref self and return self is OK
    self.x = x
    self
  }
)

a_1.f1(3)
var a_2 = a_1.f1(4)  // a_2 is updated, not a_1
assert a_1.x == 3 and a_2.x == 4

// Same behavior as in a function with UFCS
fun2 = fun (ref self, x) { self.x = x }

a_1.fun2(10)
var a_3 = a_1.fun2(20)
assert a_1 == 10 and a_3 == 20

Since UFCS does not allow shadowing, a wrapper must be built or a compile error is generated.

var counter = (
  ,var val:i32 = 0
  ,let inc = fun (ref self, v){ self.var += v }
)

assert counter.val == 0
counter.inc(3)
assert counter.val == 3

let inc = fun (ref self, v) { self.var *= v } // NOT INC but multiply
counter.inc(2)             // compile error, multiple inc options
assert 44.inc(2) == 8

counter.val = 5
let mul = inc
counter.mul(2)             // call the new mul method with UFCS
assert counter.val == 10

mul(counter, 2)            // also legal
assert counter.val == 20

It is possible to add new methods after the type declaration. In some languages, this is called extension functions.

let t1 = (a:u32)

var x:t1 = (a=3)

t1.double = proc(ref self) { self.a *= 2 }  // extension function
// previous is exactly the same as:
// t1 = t1 ++ (double = proc(ref self) { self.a *= 2 })

var y:t1 = (a=3)
x.double             // compile error, double method does not exit
y.double             // OK
assert y.a == 6

Constraining arguments

Arguments can constrain the inputs and input types. Unconstrained input types allow for more freedom and a potentially variable number of arguments generics, but it can be error-prone.

unconstrained declarationconstrained declaration

foo = fun (self) { puts "fun.foo" }
a = (
  ,foo = fun () {
     bar = fun() { puts "bar" }
     puts "mem.foo"
     return (bar=bar)
  }
)
b = 3
c = "string"

b.foo         // prints "fun.foo"
b.foo()       // prints "fun.foo"
x = a.foo     // prints "mem.foo"
y = a.foo()   // prints "mem.foo"
x()           // prints "bar"

a.foo.bar()   // prints "mem.foo" and then "bar"
a.foo().bar() // prints "mem.foo" and then "bar"
a.foo().bar   // prints "mem.foo" and then "bar"

c.foo         // prints "fun.foo"

foo = fun (self:int) { puts "fun.foo" }
a = (
  ,foo = fun () {
     bar = fun() { puts "bar" }
     puts "mem.foo"
     return (bar=bar)
  }
)
b = 3
c = "string"

b.foo         // prints "fun.foo"
b.foo()       // prints "fun.foo"
x = a.foo     // prints "mem.foo"
y = a.foo()   // prints "mem.foo"
x()           // prints "bar"

a.foo.bar()   // prints "mem.foo" and then "bar"
a.foo().bar() // prints "mem.foo" and then "bar"
a.foo().bar   // prints "mem.foo" and then "bar"

c.foo         // compile error, undefined 'foo' field/call

The where statement also allows to constrain arguments. This is a sample of fibonnaci implementation with and without where clauses. Section overload has more details on the method overloading.

let fib1 = fun(n) where n==0 {0}
        ++ fun(n) where n==1 {1}
        ++ fun(n)            { fib1(n-1) + fib1(n-2) }

assert fib1(10) == 55

let fib2 = fun(n) {
  return match n {
    == 0 {0}
    == 1 {1}
    else {fib2(n-1) + fib2(n-2)}
  }
}

assert fib2(10) == 55